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Message  from  the  Superintendent 


The  Boston  Public  Schools  has  initiated  a  comprehensive  school  improvement  and  ac- 
countability effort.  The  context  for  this  was  provided  by  the  development  of  School-Based 
Management  and  by  the  Boston  Teachers'  Union  Contract  of  1989.  The  mechanism  for  ac- 
countability has  been  put  in  place  through  the  development  of  Armual  and  Three- Year  School 
Plans.  The  use  of  the  planning  process  and  multiple  indicators  of  school  performance  allows 
schools  to  address  their  particular  needs  while  providing  a  fuller  and  more  complete  picture  of 
how  well  schools  are  educating  our  children. 

This  Educational  Planning  Resource  Guide  is  offered  to  the  BPS  school  community  as  a 
way  to  help  schools  carry  out  all  phases  of  the  educational  planning  cycle.  It  is  organized  by 
the  various  components  of  the  cycle  and  is  intended  to  be  a  "living"  document,  revised,  up- 
dated, or  added  to  as  necessary. 


Lois  Harrison-Jones,  Superintendent 
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OVERVIEW  OF  MANUAL 

The  purpose  of  this  document  is  to  provide  you  with  readily  available  information 
on  the  various  elements  of  the  planning  process.  It  is  organized  into  the  following  seven 
sections,  each  of  which  is  an  element  of  the  planning  cycle. 

Systemwide  Indicators 

Assessing  Needs 

Developing  Goals,  Objectives,  and  Measures  of  Success 

Developing  Action  Plans 

Implementation 

Monitoring  -  Assessment  and  Evaluation 

Intervention 
Also  included  are  a  bibliography.  Appendix  A,  which  contains  sample  surveys.  Appendix ' 
B,  which  contains  information  on  statistical  surveys,  and  Appendix  Q  which  contains 
sample  forms  that  are  used  in  the  process. 

As  you  move  through  the  process,  you  should  refer  to  the  particular  section  of 
relevance  for  suggestions  on  appropriate  procedures  to  follow.  Periodically,  as  policies  or 
procedures  change,  various  sections  wiU  be  updated  or  revised. 

BACKGROUND  OF  PLANNING  CYCLE 

Since  the  mid-1970's  each  BPS  school  has  been  producing  an  annual  plan.  More  re- 
cently, a  number  of  schools  have  engaged  in  longer  range  plarming  as  part  of  one  or  more 
initiatives,  i.e.  School-Based  Management/Shared-Decision  Making,  Chapter  636  STAR, 
and  Chapter  1  Schoolwide  Projects.  By  taking  a  three  year  rather  than  a  one  year  perspec- 
tive on  improving  their  school,  each  school's  community  can  develop  a  richer  vision  of 
what  should  be  happening  in  the  school  at  the  end  of  the  cycle  and,  correspondingly,  de- 
velop a  fuUer  implementation  plan  that  is  more  likely  to  enable  the  school  community  to 
achieve  their  vision. 

Recognizing  the  value  of  this  longer  cycle,  the  Superintendent,  in  consultation  with 
the  Zone  Superintendents  has  put  in  motion  a  systemwide  three  year  planning,  im- 
plementation and  evaluation  cycle  which  includes  an  initial  planiung  phase  followed  by 
three  yearly  implementation  phases.  To  ensure  that  schools  are  making  progress  toward 
their  overall  three-year  goal,  schools  will  engage  in  yearly  evaluations.  These  yearly  evalu- 
ations will  provide  information  to  both  the  school  and  the  wider  BPS  community  about  the 
school's  performance  relative  to  the  systemwide  indicators  and  the  school's  yearly  plan. 
The  results  of  the  first  two  yearly  assessments  are  to  be  used  to  guide  'mid-course' 
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corrections,  if  needed.    By  the  end  of  the  third  year,  SY1994-95,  each  school  will  document 
their  status  in  relation  to  their  overall  three-year  goal. 


ELEMENTS  OF  THE  THREE-YEAR  CYCLE 

In  most  respects,  a  three-year  planning  and  implementation  cycle  is  the  same  as  the 
one  year  cycle.  This  cycle  is  depicted  in  Chart  #1. 

Needs  Analysis 

Each  school  begins  with  a  planning  phase.  Schools  begin  this  phase  by  examining 
their  current  status  in  relation  to  their  vision,  or  mission  statement,  of  how  their  school 
should  be.  Then  the  school  identifies  the  needs  that  are  keeping  the  school  from  resem- 
bling their  vision.  This  initial  part  of  the  planning  phase  is  called  the  'Needs  Analysis'  (or 
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oftentimes,  the  'Needs  Assessment').  The  Needs  Analysis  goes  beyond  just  identifying 
needs  by  following  up  the  identification  process  with  a  decision-making  process  where  the 
needs  are  prioritized.  This  phase  should  culminate  with  the  production  of  a  prioritized  list 
of  needs  to  be  addressed  by  the  school  during  the  next  three  years. 

Developing  the  Plan 

With  the  prioritized  needs,  the  school  can  begin  to  develop  the  Three- Year  Plan. 
This  phase  begins  by  formulating  solutions  to  eliminate  or  ameliorate  the  needs.  Once  po- 
tential solutions  have  been  identified,  the  school  can  establish  overall  Three- Year  goals. 
The  solutions  are  then  converted  into  activities  which  will  occur  during  each  year  of  the 
plan.  By  dividing  the  implementation  phase  into  three  discrete  periods,  specific  objectives 
can  be  stated  for  each  yearly  period.  This  phase  ends  with  the  production  of  a  three-year 
school  plan.  The  plan  should  include  the  three-year  goal,  objectives  and  measures  of  suc- 
cess for  each  year,  a  detailed  activity  plan  for  Year  1  and  overviews  of  activities  and  re- 
sources needed  for  Years  2  and  3. 

Implementing  and  Monitoring 

After  the  Three- Year  Plan  has  been  reviewed  and  received  final  approval  by  the 
Zone  Superintendent,  in  the  Fall  of  1992,  the  Implementation  phase  formally  begins.  This 
three  year  long  phase  is  punctuated  by  three  discrete  periods  of  implementation  and  ongo- 
ing monitoring.  The  entire  school  commimity  should  be  aware  of  the  target  three-year 
goal,  the  current  year's  objective  and  the  major  activities  to  occur  during  the  year.  As  par- 
ticipants are  implementing  various  aspects  of  the  yearly  plan,  ongoing  monitoring  should 
be  going  on  both  informally  at  the  classroom  level  and  somewhat  more  formally  at  the 
school  level  through  discussions  at  regular  meetings.  This  ongoing  monitoring  is  the  basis 
of  'fine-tuning'  the  activities  as  the  year  progresses. 

Evaluating  Outcomes 

This  formal  assessment  process  occurs  on  a  yearly  basis.  The  evaluation  should  be 
guided  by  the  yearly  objectives  and  the  systemwide  school  indicators.  Each  school  needs 
to  determine  if  their  objectives  are  being  met  and  simultaneously  if  they  are  fulfilling  the 
systemwide  expectations  for  their  school.  The  results  of  this  yearly  evaluation  should  be 
incorporated  into  the  development  of  the  activity  plan  for  the  subsequent  year.  The  find- 
ings from  the  yearly  evaluation  are  to  be  shared  with  both  the  school's  community  and  the 
wider  BPS  community. 
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OVERVIEW 

Boston  Public  Schools  have  embarked  on  a  new  approach  to  educational  plan- 
ning and  accountability.  The  system  as  a  whole  has  engaged  in  the  process  of  determin- 
ing what  standards  schools  should  meet,  and  schools  have  each  developed  specific 
plans  to  meet  them.  The  goal  of  this  extensive  effort  is  simply  stated  in  the  Mission  State- 
ment for  the  Boston  Public  Schools:  "The  Boston  Public  Schools  pledges  to  provide  all  our 
students  with  good  schools  and  a  good  education.. .We  believe  all  children  can  leam" 
(Superintendent's  Circular  No.  33, 1992-1993). 

A  major  outcome  of  the  school  system's  work  over  the  last  several  years  has  been 
the  development  of  Systemwide  Standards  by  which  schools  and  the  school  system  as  a 
whole  are  held  accountable.  Planning  on  how  to  improve  on  the  Systemwide  Standards 
needs  to  be  a  part  of  each  school's  planning  process. 

Systemwide  Indicators  and  Systemwide  Standards:  In  1991-1992  the  effort  began 
with  a  consolidation  of  previous  processes  and  the  identification  of  a  variety  of  indica- 
tors to  measure  student  and  school  performance.  Between  June  and  October  of  1992,  a 
great  deal  of  analysis  and  examination  of  the  school  system's  performance  was  con- 
ducted. Members  of  the  Compact  Measurement  Committee  worked  very  closely  with 
the  Superintendent  and  Zone  Superintendents  to  review  data  and  establish  a  draft  ver- 
sion of  systemwide  indicators  and  standards.  Past  practice  and  the  research  literature 
on  student  performance  and  school  effectiveness  were  both  used  as  a  basis  for  develop- 
ing the  standards.  In  1992-1993  these  standards  were  reviewed  and  revised  as  needed. 

At  the  present  time,  data  are  reported  to  the  schools  on  over  35  Systemwide  Indi- 
cators. Systemwide  indicators  should  not  be  confused  with  School  Level  Indicators 
which  are  also  an  important  part  of  each  school's  educational  plan.  School  Level  indica- 
tors are  chosen  by  each  school  as  measures  of  their  success  in  implementing  plans  to  ad- 
dress the  Superintendent's  Priorities. 

The  purpose  for  setting  standards  was  to  focus  the  entire  BPS  educational  com- 
munity on  ambitious  but  achievable  goals  for  performance  on  those  indicators  that  re- 
search has  shown  to  be  appropriate  measures  of  school  effectiveness.  The  process  of 
setting  standards  has  been  done  deliberately  and  carefully.  When  a  standard  is  set,  the 
system  is  making  a  commitment  to  achieving  the  standard  within  three  years.  Current- 
ly, standards  have  been  set  for  15  indicators.  Ln  recognition  of  the  fact  that  improving  a 
whole  school  system  is  an  ambitious  undertaking,  the  final  attainment  of  the  goals  is 
not  expected  until  the  1994-1995  school  year.  At  that  time,  it  is  planned  that  all  schools 
will  have  attained  or  surpassed  the  standards. 

Standards  have  been  set  relative  to  two  types  of  comparisons.  Some  have  been 
set  relative  to  a  fixed  number.    Those  include  student  attendance,  percent  promoted, 
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percent  eligible  taking  the  MAT6,  and  staff  attendance.  A  specific  number  has  been  set 
as  a  goal  for  each  of  those  indicators.  Other  standards  have  been  set  in  terms  of  com- 
parison with  baseline  performance  (i.e.,  suspensions,  standardized  test  score  achieve- 
ment. Special  Needs  Prototype  changes  and  referral  rates).  For  these  standards  the  base 
comparison  year  is  1991-1992. 

In  this  chapter  both  the  Systemwide  Indicators  for  School  Performance  Review 
and  the  Systemwide  Standards  are  reproduced.  These  docimients  are  identical  to  those 
which  have  already  been  approved,  reviewed  by  the  schools,  and  disseminated. 
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Systemwide  Indicators  for  School  Performance  Review 

1.  Percent  of  students  attending  the  school  for  the  entire  year 

2.  Average  daily  student  attendance 

a.  number  with  perfect  attendance 

b.  number  absent  1  to  5  days 

c.  number  absent  between  6-10  days 

d.  number  absent  more  than  11  days 

3.  Percent  of  students  not  attaining  85%  attendance 

4.  Number  and  percent  promoted 

5.  Number  suspended 

6.  Percent  that  dropped  out  (Grades  6-12) 

a.  annual 

b.  cohort 

7.  Metropolitan  Achievement  Test  median  percentiles  for  Reading  and 
Mathematics 

a.  percent  of  the  school's  eligible  popvilation  taking  the  MAT6  tests 

b.  percent  of  students  scoring  below  the  40th  percentile,  40-60th  percentile,  and 
above  the  60th  percentile 

8.  Number  of  SPED  students  reviewed 

a.  number  of  SPED  students  whose  prototype  increased 

b.  number  of  SPED  students  whose  prototype  decreased 

9.  Number  of  new  referrals  to  SPED 

a.  referred  by  school 

b.  referred  by  external  agencies 

c.  referred  by  parent 

d.  with  pre-referral  not  waived 

10.  Percent  of  Bilingual  Program  students  whose  step  increased  this  year 

11.  Percent  of  Bilingual  Program  students  in  the  prograni  under  three  years 

12.  Percent  of  Bilingual  Program  students  in  the  program  three  or  more  years 

13.  Average  staff  attendance  (teachers,  administrators) 

a.  number  with  perfect  attendance 

b.  number  sick  1  to  5  days 

c.  number  sick  between  6-10  days 

d.  number  sick  more  than  11  days 

14.  Results  of  teacher  survey^ 

15.  Results  of  parent  survey^ 

16.  Results  of  student  survey^ 

17.  Performance  assessment  scores  broken  into  percentages  in  Low,  Average,  and 
High« 

18.  Number  of  parents  of  incoming  first,  sixth,  or  ninth  graders  requesting  this 
school  as  one  of  their  top  three  choices 

19.  Percent  of  students  admiiustratively  assigned  to  the  school,  broken  down  by 
race 

20.  Placement  of  graduates 

Notes: 

A.  Development  of  surveys  is  in  progress  f 

B.  Available  when  Boston  College  pilot  is  completed 
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Systemwide  Standards 


Average  Daily  Attendance  Standard: 
Elementary  Schools  ~  95% 
Middle  Schools  -  92% 
High  Schools  -  90% 


Student  attendance  is  an  indicator  of  student  exposure  to  school  instruction. 
High  student  attendance  is  an  obvious  basic  requirement  underlying  school  effective- 
ness. Student  Attendance  is  a  percentage  calculated  as  the  average  daily  attendance  di- 
vided by  the  average  daily  membership  based  on  the  data  provided  by  each  school  to 
the  Record  Management  Unit.  The  standard  as  applied  to  elementary  schools  only  in- 
cludes grades  1-5  (Kindergarten  attendance  is  not  included  because  it  is  volimtary).  For 
the  1991  -  1992  school  year  the  average  daily  attendance  in  the  Boston  Public  Schools 
was  92.9%  for  the  elementary  level,  89.3%  at  the  middle  school  level,  and  83.7%  at  the 
high  school  level. 


Suspension  Standard: 

All  Levels:  a  reduction  by  50%  from  SY 1991  -  1992 

for  both  Occurrences  and  Pupils  Suspended 

Susper\sions  both  in  terms  of  total  occurrences  and  the  number  of  pupils  sus- 
pended indicate  a  problem  that  impacts  on  the  total  school  climate  and  atmosphere. 
For  Suspension  Occurrences,  students  may  be  counted  more  than  once  if  they  are  sus- 
pended repeatedly.  For  both  Suspension  Occurrences  and  Number  of  Pupils  Sus- 
pended, the  systemwide  indicator  reflects  suspension  activity  at  the  school  during  the 
year  even  if  a  student  transfers  to  another  school  before  the  end  of  the  year.  A  reduc- 
tion of  50%  means  a  reduction  from  the  base  year  of  1991  -  1992.  For  the  1991  -  1992 
school  year  the  number  of  suspension  occurrences  in  the  Boston  Public  Schools  was  359 
at  the  elementary  level,  1184  at  the  middle  school  level,  and  2540  at  the  high  school  lev- 
el. The  number  of  pupils  suspended  was  302  at  the  elementary  level,  893  at  the  middle 
school  level,  and  1700  at  the  high  school  level.  It  should  be  noted  that  for  schools  with 
small  student  populations  it  may  be  inappropriate  to  require  a  50%  reduction. 
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Promotion  Standard: 

Elementary  Schools  —  98% 

Middle  Schools  -  95% 

High  Schools  -  90% 


Promotion  represents  a  step  of  achievement  on  both  the  part  of  the  student  and 
the  part  of  the  school.  It  is  the  intention  of  the  BPS  Promotion  Policy  that  students  who 
are  in  danger  of  not  meeting  the  promotion  standards  be  targeted  early  in  the  year  and 
receive  the  necessary  additional  support  to  erasure  academic  success.  The  Promotion 
Rate  systemwide  indicator  is  the  percent  of  end-of-year  school  enrollment  of  students 
who  were  promoted  to  the  next  grade  as  of  June.  For  the  1991  - 1992  school  year,  the 
promotion  rates  in  the  Boston  Public  Schools  were  97.9%  for  the  elementary  schools, 
92.4%  for  the  middle  schools,  and  84.1%  for  the  high  schools. 


Dropout  Standard:  a  reduction  in  the  Annual  Dropout  Rate  by 

Middle  Schools  --  1  percentage  point  from  SY 1991-92 

High  Schools  —  3  percentage  points  from  S\  1991-91 

Dropout  provides  one  perspective  on  a  school's  holding  power.  Students  are 
considered  dropouts  if  they  were  discharged  with  any  of  the  following  categories:  over 
16,  withdrew  to  get  married,  withdrew  to  enter  military,  withdrew  to  work,  registered 
but  did  not  report,  moved  with  no  forwarding  address.  Students  who  transferred  out 
of  the  system  are  not  included  in  the  calculations.  For  1989  -  90  and  1990  -  91,  the  proce- 
dures differed  somewhat  because  age  was  taken  into  account.  This  will  have  the  great- 
est impact  in  the  middle  schools.  In  accordance  with  state  guidelines,  summer  dropouts 
are  counted  at  the  school  to  which  they  were  assigned  for  the  fall.  For  the  1991  - 1992 
school  year,  the  dropout  rates  in  the  Boston  Public  Schools  were  1.8%  for  grades  6-8 
and  9.1%  for  grades  9  - 12. 


MATS  Percent  Eligible  Standard  (Reading  and  Mathematics): 

Elementary  Schools  —  98% 

Middle  Schools  -  95% 

High  Schools  -  95% 

It  is  important  from  both  an  instructional  and  accountability  perspective  that  all 
students  defined  within  the  eligible  population  should  be  regularly  assessed  for  their 
level  of  achievement.  Testing  periods  generally  extend  for  about  a  week  and  a  half  to 
ensure  that  students  who  are  absent  on  the  day  of  schoolwide  testing  are  able  to  make 
up  the  examination.  The  eUgible  population  is  regular  education,  SPED  .1  and  .2,  and 
Bilingual  Education  students  in  Steps  4  and  5  who  are  required  to  take  the  Metropolitan 
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Achievement  Test.  The  percent  is  calcvilated  by  dividing  the  number  of  eligible  stu- 
dents for  whom  answer  documents  are  returned  by  the  total  niunber  of  eligible  stu- 
dents in  the  school.  For  the  1991  -  1992  school  year,  the  percent  of  eligible  tested  were 
as  follows:  92.5%  for  elementary  schools,  91.2%  for  middle  schools,  and  82.6%  for  high 
schools. 


Norm  Referenced  Test  Achievement  Standard  -  For  All  Levels, 
for  Reading  and  Mathematics: 

1.  The  number  of  students  scoring  in  the  low  range  on  the 
Metropolitan  Achievement  Test  (below  the  40th  percentile) 
will  decrease  by  10  percentage  points  from  SY1991-92. 

2.  The  number  of  students  scoring  in  the  high  range  on  the 
Metropolitan  Achievement  Test  (above  the  60th  percentile) 
will  increase  by  5  percentage  points  from  SY1991-92. 

This  pair  of  indicators  provides  general  information  about  the  percentage  of  stu- 
dents scoring  at  the  low  and  high  ranges  for  the  school  as  a  whole  relative  to  national 
norms  on  the  Metropolitan  Achievement  Test.  The  percentage  is  based  on  the  niunber 
of  eligible  students,  the  low  range  includes  the  percent  of  students  scoring  below  the 
40th  percentile;  the  high  range  includes  the  percent  of  students  scoring  above  the  60th 
percentile.^  Ciu-rently,  the  percentages  scoring  in  the  various  percentile  ranges  in 
Reading  and  Mathematics  on  the  Metropolitan  Achievement  Test  administered  in  the 
spring  of  1992  are  as  foUows: 


Elementary 

Middle 

High 

PctI  Range: 

<40th        40th-60th         >60th 

<40th 

40th-  60th 

>60th 

<40th 

40th-  60th 

>60th 

Read 
Math 

31 .9          20.4          40.3 
23.7          17.9          50.5 

36.9 
30.8 

20.8 
19.6 

33.5 
40.2 

36.8 
33.0 

16.3 
17.1 

29.6 
31.2 

Particular  caution  is  being  exercised  since  the  standards  are  based  upon  a  par- 
ticular instrument.  The  standards  now  being  developed  are  based  on  the  current  ver- 
sion of  the  Metropolitan.  Within  the  next  year  a  new  instrument  with  newer  norms  will 
be  adopted  systemwide  which  will  render  student  results  incomparable  with  prior 
years.  New  norms  will  complicate  the  comparisons  somewhat. 


For  example,  School  A  has  53%  of  student  scores  falling  within  the  low  range.  By  1994-95  they  should 
show  43%  or  fewer  (53%  - 10%)  falling  within  the  low  range.  Note  that  standards  are  set  for  the  low  and 
high  ranges  only;  the  average  range,  "40th-60th",  has  been  eliminated.  The  reason  for  this  can  be  il- 
lustrated by  the  following  example.  Suppose  the  standard  for  the  average  range  required  a  decrease  of 
5%;  and  suppose  for  a  particular  school,  25  students  moved  from  low  to  average  and  25  from  average 
to  the  high  range,  in  this  case  the  average  range  would  show  no  change  although  the  school  had 
achieved  the  purpose  of  the  standard. 
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Performance-Based  Assessment  Achievement  Standard: 
available  when  the  Boston  College  pilot  is  complete 

These  indicators  provide  additional  achievement  information  from  performance- 
based  assessments. 


Staff  Attendance  Standard: 
All  Levels:  98% 


While  absences  due  to  illness  are  inevitable,  high  staff  attendance  is  a  prerequi- 
site for  high  school  delivery  standards.  For  the  Staff  Attendance  indicator,  staff  include 
administrators,  teachers,  and  professional  support  staff.  Other  support  staff  are  not  in- 
cluded. It  is  important  to  note  that  days  absent  include  only  sick  days.  Attendance  at  ap- 
proved educational  conferences,  approved  leaves,  jury  duty,  and  personal  days  are 
excluded.  The  Staff  Attendance  rate  is  the  total  number  of  staff  days  present  divided  by 
the  total  number  of  staff  days  possible.  For  the  1991  - 1992  school  year,  the  average  staff 
attendance  was  96.6%  at  the  elementary  and  middle  school  levels,  and  95.9%  at  the  high 
school  level. 


Special  Education  Standards 

1.  Prototype  Increases:  10%  or  lower 

2.  Prototype  Decreases:  50%  or  higher 

3.  New  Referrals:  Reduction  of  50%  or  more  from  SY1991-92 

It  is  the  policy  of  the  Special  Education  program  for  the  Boston  Public  Schools 
that  students  remain  in  Special  Education  only  as  long  as  needed  to  provide  specialized 
supports  to  assist  students  in  their  education.  In  general,  the  goal  of  Special  Education 
is  for  students  to  return  to  the  regular  education  framework  with  the  necessary  skills 
and  development  for  success.  For  this  reason,  it  is  hoped  that  each  school  will  show 
progress  with  respect  to  the  number  of  students  whose  prototype  decreases.  Related  to 
this,  of  course,  is  the  number  of  students  whose  prototype  increases  and  the  number  of 
new  referrals  to  the  Special  Education  program.  SPED  standards  involve  prototype  in- 
creases, decreases,  and  the  number  of  new  referrals.  SPED  increases  refers  to  the  num- 
ber of  students  whose  prototype  increased  during  the  school  year  within  the  school. 
This  includes  students  moving  from  Regular  Education  into  SPED.  SPED  decreases  re- 
fers to  the  number  of  students  whose  prototype  decreased  during  the  school  year  with- 
in the  school.  This  includes  students  mainstreamed  out  of  SPED  altogether.  New 
Referrals  is  the  total  number  of  new  referrals  to  SPED  occurring  within  the  school  dur- 
ing the  school  year.  It  should  be  noted  that  for  some  schools  it  may  be  inappropriate  to 
require  them  to  reduce  the  nimiber  of  new  referrals  by  50%. 
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Bilingual  Standard: 

Percent  of  Bilingual  Program  Students  with  Step  increases: 

Elementary  Schools  —  35% 

Middle  Schools  -  50% 

High  Schools  -  50% 

It  is  the  policy  of  the  Boston  Public  Schools  that  each  bilingual  student  enters  the 
regular  education  framework  with  the  necessary  language  skills  and  development  for 
success  in  future  coursework.  Students  are  individually  reviewed  each  year  by  the  Lan- 
guage Assessment  Team  at  each  school.  The  team  assigns  a  Bilingual  Program  Step 
which  reflects  the  an\ount  of  partial  mainstreaming  that  a  student  should  receive. 
Movement  through  bilingual  programs  is  a  gradual  mainstreaming  process.  For  this 
reason,  it  is  hoped  that  each  school  will  show  progress  with  respect  to  the  number  of 
students  whose  Bilingual  Program  Step  increases.  A  Step  increase  is  defined  as  a 
change  to  Step  2,  3,  or  4.  Students  moving  out  of  the  Bilingual  Education  program  (i.e. 
from  Step  4  out)  are  not  included.^  Step  changes  are  determined  by  comparing  the  Step 
assignment  at  the  end  of  one  year  with  the  Step  assignment  at  the  end  of  the  previous 
year.  The  percentage  is  based  on  the  number  of  students  with  Step  increases  divided 
by  the  total  Bilingual  Education  program  erirollment. 


School  Choice  Standard: 
All  Levels  --  increase  relative  to  previous  year 

This  is  the  nvimber  of  regular  education  students  in  grades  \,  6,  and  9  who  re- 
quested the  school  as  the  top  choice  in  the  first  round. 


^  These  Step  numbers  have  been  revised  to  correspond  with  the  new  Step  codes  that  are  part  of  the  LAU 
plan  which  was  revised  in  the  spring  of  1 993. 
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Assessing  Needs 

A  need  can  be  defined  as  the  gap  between  current  results  and  desired  results. 
The  prerequisite  to  assessing  needs  in  your  school  is  a  clear  vision  of  the  desired  results 
which,  in  turn,  is  based  on  the  school's  educational  mission.  This  vision  needs  to  hold 
together  as  a  whole  rather  than  represent  a  patchwork  of  relatively  unrelated  pieces. 
The  educational  mission  should  encompass  the  four  Superintendent's  Priorities  but 
should  build  from  them  to  include  a  broad  and  integrated  scope  of  what  your  school 
community  envisions  as  the  result  of  its  educational  process. 

There  are  three  parts  to  a  needs  analysis: 

1.  identifying  needs,  i.e.,  gaps  or  discrepancies  between  current  results  and 
desired  results; 

2.  prioritizing  the  needs; 

3.  selecting  the  most  important  needs  in  order  to  close  or  substantially  reduce 
the  gaps  between  what  is  and  what  should  be. 

Each  school  begins  with  a  planning  phase.  Schools  begin  this  phase  by  examining 
their  current  status  in  relation  to  their  vision,  or  mission  statement,  of  how  their  school 
should  be.  Then  the  school  identifies  the  needs  that  are  keeping  the  school  from  realiz- 
ing their  vision.  These  activities  fall  imder  identifying  needs,  which  involves  data  gath- 
ering and  analysis;  they  are  covered  in  the  section  titled  "Using  Data  to  Review  School 
Status".  The  Needs  Analysis  goes  beyond  just  identifying  needs  by  following  up  with  a 
decision-making  process:  prioritizing  the  needs.  This  part  of  the  process  is  covered  in 
the  sections  titled  "Summarizing  Data  Collected  in  Preparation  for  Selecting  and  Priori- 
tizing Needs",  and  "Procedures  for  Selecting  and  Prioritizing  Needs".  A  worksheet  is 
provided  to  help  you  in  this  process.  Its  use  is  optional.  This  phase  should  culminate 
with  the  production  of  a  prioritized  list  of  needs  to  be  addressed  by  the  school  during 
the  next  three  years.  This  final  part  falls  under  selecting  needs  and  is  covered  in  the  sec- 
tions "Procedures  for  Selecting  and  Prioritizing  Needs",  and  "Documenting  Findings 
and  Recommendations  from  the  Needs  Assessment."  Chart  1  on  the  next  page  depicts 
the  needs  analysis  phase  within  the  educational  plaiming  cycle. 

ORGANIZING  THE  NEEDS  ANALYSIS  PHASE 

While  there  are  many  ways  to  orgaiuze  the  activities  associated  with  the  needs 
analysis,  some  suggestions  are  offered  below.  Note  that  these  activities  will  have  a  lim- 
ited scope  in  planning  Years  Two  and  Three. 

The  process  should  be  as  inclusive  as  possible  both  in  terms  of  people  involved 
and  areas  to  be  examined.  In  terms  of  input  into  the  identification  and  prioritization  of 
needs,  special  efforts  should  be  made  to  include  the  School  Site  Council,  the  wider 
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school  community,  and  parents,  especially  those  parents  who  rarely  have  a  voice  in 
school  affairs.  Surveys,  telephone  conversations  and  informal  meetings  at  the  school  or 
perhaps  among  small  groups  of  parents  at  their  homes  are  some  ways  to  broaden  the 
input  of  parents  into  the  Needs  Analysis. 

When  examining  the  school's  status,  some  of  the  topics  to  be  covered  are  listed 
below.  This  list  is  meant  to  be  suggestive;  it  is  not  meant  to  be  exhaustive  or 
mandatory. 


1.  Student  Achievement 

2.  Parent  Involvement 

3.  School  Governance 

4.  Professional  Development 

5.  Instructional  Methods 

6.  Interdisciplinary  Team  Organization 

7.  Content  Area  Iristruction 

8.  Tracking/ Ability  Grouping 


9.  Teacher  Expectations 

10.  Discipline 

11.  'At  Risk' Students 

12.  Student  Motivation 

13.  Eruichment 

14.  Remediation 

15.  Cooperative  Learning 


Chart  1 

Boston  Public  Schools 

Three  Year  Plan 

School  Planning,  Implementing  and  Evaluating  Cycle 

_^^^^^    Needs  Analysis  Phase 
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The  Needs  Analysis  phase  for  the  Three- Year  Plan  formally  began  with  the  sys- 
temwide  inservice  day  on  March  9,  1992,  but  the  process  should  be  repeated  on  a 
smaller  scale  each  subsequent  year  of  the  cycle.  It  will  be  repeated  formally  and  thor- 
oughly at  the  begining  of  the  each  three  year  cycle.  For  each  three  year  cycle,  on  a  des- 
ignated inservice  day,  schools  will  have  the  opportunity  to  review  their  statvis  vis-a-vis 
the  current  Educational  Plan  and  to  plan  their  activities  for  the  remainder  of  this  phase. 
By  reviewing  currently  available  data,  e.g..  School  Profiles,  MAT6  Receiving  School  Re- 
ports, etc.,  the  school  community  can  begin  to  identify  what  further  iiiformation  will 
have  to  be  collected  for  the  Needs  Analysis.  Depending  on  the  size  of  the  school,  staff 
can  be  divided  into  data  gathering  groups  which  will  assume  responsibility  for  various 
aspects  of  the  Needs  Analysis.  For  example,  groups  could  be  created  along  the  lines  of 
the  Superintendent's  Priority  Areas.  Alternatively,  groups  could  be  created  to  pursue 
various  types  of  data,  e.g.,  parent  input,  teacher  records,  classroom  observation,  etc. 

After  a  data  collection  period,  the  groups  can  present  a  preliminary  report,  either 
verbally  or  in  written  format,  to  the  rest  of  the  school  commiuuty.  Depending  on  the 
feedback  received  from  the  school  community,  the  data  gathering  groups  can  either  go 
back  to  obtain  further  data  or  finalize  their  list  of  identified  needs.  In  April,  this  list  of 
needs  should  be  presented  to  the  school  community  for  their  input  regarding  priorities. 
This  prioritized  list  of  needs  will  then  serve  as  the  basis  for  the  rest  of  the  planning 
process. 

YEARS  TWO  AND  THREE  OF  THE  THREE  YEAR  PLAN 

A  thorough,  full  scale  needs  analysis  will  occur  prior  to  drafting  each  Three- Year 
Plan.  However,  a  smaller  scale  needs  analysis  will  need  to  be  carried  out  in  preparation 
for  drawing  up  the  action  plans  for  Years  Two  and  Three  of  the  3-year  cycle.  The  pur- 
pose of  these  needs  analyses  will  be  to  gather  information  necessary  to  ensure  that  the 
plan  is  on  track,  to  identify  ways  the  Plan  may  need  to  be  modified,  and  to  help  deter- 
mine what  action  steps  should  be  defined  for  the  Years  Two  and  Three  Action  Plaris. 

NEXT  STEPS 

This  chapter  is  designed  for  schools  to  use  as  a  resource  as  they  move  through  the 
various  needs  analysis  activities.  These  steps  are  reproduced  in  Figure  1  below  and  each  is 
elaborated  in  a  section  within  this  chapter.  Finally,  both  the  Level  offices  and  the  Office  of 
Research  and  Development  are  available  to  provide  schools  with  assistance  during  this 
and  subsequent  phases  of  the  three  year  cycle. 
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Figure  1 

Steps  to  Completing  the  Needs  Analysis  and  Where  to  Find  Information 


If  vou  need  to  know  more  about ... 


COLLECTING  DATA  -  Using  Data  to  Review  School  Status 

BPS  School  Profiles 

What  Are  School  Profiles? 

Some  Questions  To  Explore  In  School  Profiles 
School  Profiles  Composite  Page 
Reviewing  the  Midyear  Progress  Report 

Systemwide  Indicators 

School  Level  Measures  Of  Success 
Reviewing  Metropolitan  Achievement  Test  Data 

Using  the  Receiving  School  Reports 

Using  the  AWC  MAT6  Report 

Using  MAT6  Data  in  School  Profiles 

Other  Issues  to  Consider 
The  Current  Educational  Plan  Document 

Identifying  Needs 

Establishing  Goals  And  Objectives 

Implementing  The  Plan 
Other  Data  Sources 

Teachers'  Records 

Students'  Grades  And  Portfolios 

Observation  In  Classrooms  And  Other  Settings 

Surveys  And  Individual  Interviews 

Group  Discussions  or  Interviews 

Summarizing  Data  Collected  in  Preparation  for  Selecting  and 
Prioritizing  Needs 

Categories 
Organizing  The  Data 

Procedures  for  Selecting  and  Prioritizing  Needs 

REPORTING  -  Documenting  Findings  and  Recommendations 
from  the  Needs  Assessment 

Next  Steps:  Moving  from  the  Needs  Analysis  to  a  Plan  of  Action 
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NA-5 

NA-7 

NA-8 

NA-8 

NA-10 
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NA-11 

NA-12 

NA-12 

NA-12 

NA-13 

NA-13 

NA-13 

NA-13 

NA-15 

NA-15 

NA-15 

NA-16 

NA-17 

NA-17 

NA-19 


NA 

-19 

NA 

-20 

NA- 

24 

NA- 

26 

NA-27 
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COLLECTEsfG  DATA 
Using  Data  to  Review  School  Status 

BPS  SCHOOL  PROFILES 


WHAT  ARE  SCHOOL  PROFILES? 

School  Profiles  is  a  yearly  compendium  of  information  about  each  BPS  school.  It 
contains  information  maintained  by  various  units  within  the  central  administration,  e.g.. 
Department  of  Implementation,  Records  Management  Unit,  Office  of  Research  and  Devel- 
opment, Budget  Office,  Personnel  Office,  Special  Education,  and  the  Office  of  Bilingual 
Education.  School  Profiles  includes  information  about  topics  such  as  school  capacity  and 
utilization,  student  characteristics  and  achievement,  staff  characteristics,  and  yearly 
budget. 

With  its  wealth  of  data.  School  Profiles  is  a  useful  starting  point  for  information 
about  a  school  over  the  past  few  years.  However,  School  Profiles  should  be  seen  as  a  tele- 
scopic view  of  the  school.  While  certain  features  of  the  landscape  may  be  observed  via 
School  Profiles,  the  dociunent  is  no  substitute  for  "being  there'.  As  a  tool  for  needs  analysis. 
School  Profiles  is  meant  to  be  a  point  of  departure.  Thus,  the  school's  data  can  serve  as  a 
guide  into  areas  which  may  be  of  importance  either  in  terms  of  identifying  needs  or  in 
terms  of  generating  solutions  to  the  identified  needs. 

SOME  QUESTIONS  TO  EXPLORE  IN  SCHOOL  FROHLES 

Listed  below  are  some  questior\s  that  can  be  explored  with  School  Profiles  as  a  start- 
ing point.  A  'composite'  page  from  School  Profiles  (combining  data  from  several  schools) 
is  provided. 

1.  How  is  space  being  used  in  the  building? 
(See:  Program  Data  -  Percent  Utilization) 

2.  Is  the  composition  of  the  school  or  specific  grades  changing? 

(See:  Student  Data  -  Enrollment  Percentages  by  Racial/Ethnic  Group) 

3.  Are  there  disparities  in  promotion  rates  among  racial /ethnic  groups  or 
programmatic  groups?  (See:  Student  Data  -  Percent  Promoted  as  of  6/91) 

4.  How  does  the  school  handle  the  integration  of  special  needs  and  bilingual 
education  students?  (See:  Student  Data  -  Special  Education  and  Bilingual 
Education) 

5.  Is  the  nimtber  of  referrals  for  Special  Education  Evaluations  high  relative  to 
your  school's  total  population?  (See:  Student  Data  -  Special  Education,  #  of 
Referrals  to  766  Evaluation) 
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6.  Are  many  special  education  students  retiuning  to  regular  education?  (See: 
Student  Data  -  Special  Education,  #  Returned  to  Regular  Education) 

7.  What  kind(s)  of  support  are  needed  for  bilingual  (and  linguistic  minority) 
students?  (See:  Student  Data  -  Bilingual  Education) 

8.  Are  students  missing  a  lot  of  school  due  to  absenteeism?    (See:    Student 
Data  -  Attendance  and  Discipline  Indicators) 

9.  Who  is  being  affected  by  student  suspensions?     (See:     Student  Data  - 
Suspensions) 

10.  How  is  your  school  affected  by  student  movement?    (See:    Student  Data  - 
Student  Movement  and  Student  Loss) 

11.  What  staffing  patterns  does  your  school  use?    (See  both:  Staff  Data  -  Staff 
Data  and  Program  Data  -  Program  Enrollment) 

12.  How  do  staff  absences  affect  your  school?  (See:  Staff  Data  -  Attendance) 

13.  Is  the  staff  continuing  to  further  their  professional  development  through  a 
formal  degree  program?  (See:  Staff  Data  -  Educational  Level) 

14.  How  much  does  it  cost  to  educate  the  students  at  the  school?  (See:  Per  Pupil 
Costs) 
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PRINCIPAL:      DORTHY  SMITH 
ADDRESS:        123  COURT  ST   EAST  BOSTON,  MA  02108 
TELEPHONE:      726  6200    SCHOOL  CODE:  9000 


PROGRAM  DATA   

Programs (6/1991) 

Regular  Education 

Bilingual  Education 

Special  Education 

Advanced  Work  Class 

*Only  substantially  separate  students  are  used  to  calculate  capacity,  program  enrollment,  and  utilization 

All  SPED  students  with  prototype  .2,    .3,  .4  are  included  in  calculating  adjusted  FTE(Full  Time  Equivalency). 


Capacity/Seats 

Program  Enrollment 

%  ntilization 

Adjusted  F.T.E 

330 

312 

94.5 

306.7 

150 

97 

64.7 

83.1 

58 

55 

94.8 

74.2 

60 

47 

78.3 

47.0 

STUDENT  DATA 

Grade  by  Racial  Ethnic  Group  (6/1991) : 


Number  of  Students  (Row  Total  %  of  Students) 


Native 

Row   % Promoted 

Grade : 

Blaclc 

White 

Asian 

Hispanic 

American 

Total  As  of  6/91 

Kindergarten 

0 

0 

0 

0 

0 

0 

0 

N/A 

Kindergarten  : 

L 

14 

56.0% 

6 

24.0% 

0 

5 

20.0% 

0 

25 

100.0% 

Kindergarten  2 

14 

30.4% 

8 

17.4% 

0 

24 

52.2% 

0 

46 

100.0% 

One 

36 

45.0% 

18 

22.5% 

1 

1.3% 

24 

30.0% 

1 

1.3% 

80 

92.5% 

Two 

39 

50.6% 

17 

22.1% 

2 

2.6% 

19 

24.7% 

0 

77 

100.0% 

Three 

39 

47.6% 

17 

20.7% 

2 

2.4% 

23 

28.0% 

1 

1.2% 

82 

100.0% 

Four 

39 

44.3% 

24 

27.3% 

5 

5.7% 

19 

21.6% 

1 

1.1% 

88 

100.0% 

Five 

44 

39.3% 

38 

33.9% 

4 

3.6% 

25 

22.3% 

1 

0.9% 

112 

100.0% 

All  Grades 

225 

44.1% 

128 

25.1% 

14 

2.7% 

139 

27.3% 

4 

0.8% 

510 

98.8% 

Bilingual 

1 

1.0% 

0 

0 

96 

99.0% 

0 

97 

100.0% 

Special  Education 

76 

47.8% 

44 

27.7% 

1 

0.6% 

36 

22.6% 

2 

1.3% 

159 

98.7% 

Advanced  Wor)c 

Class 

18 

38.3% 

19 

40.4% 

3 

6.4% 

7 

14.9% 

0 

47 

100.0% 

%  Promoted  as 

of  6/91 

98.2% 

99.2% 

- 

100.0% 

99.3% 

100.0% 

98.8% 

Special  Ed: 

.1 

.2 

3     .4 

Total 

Bilingual  Ed 

:  No  Step 

One  Two  Three  Four 

Five  Total 

Enrollment  # 

8 

48 

48      55 

159 

Enrol. 

6/91: 

15 

56 

20     6 

97 

(%) 

5.0% 

30. 

2%   30.2%   34. 

.6% 

(%) 

15.5% 

57. 

7%   20 

.6%    6.2% 

#  Referrals  to  766  Evaluations: 

43 

Enrol. 

6/90: 

2 

40 

28    19 

3    92 

#  Placements  in  Special 

Education: 

31 

(%) 

2.2% 

43. 

5%   30 

.4%   20.7% 

3.3% 

#  Returned  to 

Regular  Education: 

10 

M 

Advanced  to 

SPED  Programs: 

this  lau  step: 

2 

1 

LOW  INCID.  -  CLUST . -BRIG-Y . E . S  RESOURCE  ROCM 
SPEECH  (ITINERANT  SERVICES)     LOW  INCIDENCE  LD 
PRIMARY  (PTC) 


#  Returned  to  regular  education  this  year:     8 
%  Of  students  who  spend  40%  or  more  of  their  time 
in  regular  education  (Mainstreamed) 
6/91:    6.2%       6/90:  23.9% 
Bilingual  Programs: 
Spanish 


Attendance  and  Discipl 

.me  Indicators: 

Student  Movement: 

Black  White  Asian  Hispanic 

Total 

1988-89 

1989-90 

1990-91 

Attendance:  (K0-K2) : 

77.9% 

86.8% 

82.5% 

New  BPS  Admissions : 

18 

5 

0 

13 

36 

(G1-G5) : 

92.1% 

93.9% 

97.4% 

BPS  Transfers  In: 

33 

1 

0 

30 

64 

%  Absent  over  15%  of 

BPS  Transfers  Out: 

29 

11 

0 

32 

72 

Student  School  Year: 

N/A 

N/A 

N/A 

Programmatic  Transfer 

Requests  by  Year: 

0 

0 

0 

Discharged  to  other 
School  Systems : 

23 

5 

0    12 

41 

Suspensions: 

N/A 

N/A 

N/A 

Dropouts  (See  p.  xx) 

Unlcnown: 

Total  Loss: 

U 
11 
34 

U 
3 
8 

0     0 
0     9 
0    21 

0 
23 
64 

Total  Sum  of  Registrants 

9/1 

■ 

6/30: 

574 

Staff*: 

Blac)c  White  , 

Asian  : 

Hispanic  Total 

Attendance** : 

1990- 

91 

School  Year 

Administrators: 

0 

0 

0 

1 

1 

Perfect  Attendance: 

0 

Teachers  (Total) : 

11 

10 

0 

8 

29 

1-5  Days  Absent: 

11 

Regular  Ed: 

10 

7 

0 

0 

17 

6-10  Days  Absent: 

16 

Bilingual  Ed: 

1 

0 

0 

6 

7 

11-18  Days  Absent: 

4 

Special  Ed: 

0 

3 

0 

2 

5 

19-29  Days  Absent: 

0 

Advanced  Wor)c  Class: 

0 

0 

0 

0 

0 

30+  Days  Absent: 

1 

Proff  Support  Staff: 

1 

1 

0 

0 

2 

#  Of  Staff  who  took 

at  least 

Total  Professionals: 

12 

11 

0 

9 

32 

one  approved  leave: 

1 

Teacher  Aides: 

3 

2 

0 

6 

11 

Average  Staff  Attendance 

Rate: 

95.0% 

Clerical/Secretarial : 

0 

1 

0 

0 

1 

(excluding  approved 

leave) 

*Other  support  staff 

not  included 

.  **Administrators, 

teachers,  and  professiona] 

.  support 

Sl 

latt 

• 

Educational  Level: (Teachers  Only) 
Doctorates: 

Masters  +15,  30,  45: 
Masters: 

Advanced  Degrees*: 
*%  of  teachers  w/Masters  or  higher. 


Per  Pupil  Costs: 
0  City  Budget:  $806,080  External  Budget:  $206,367 

5  Total  Budget**:  $1,799,675 

3  Total  Adjusted  Student  FTE:    263.0 

44.4%  Est. (Weighted) School  Per  Pupil  Expenditures: .35, 353 

■•*Includes  direct  allocation  &   pro-rated  share  of  district  &  central  budget 


'  This  page  is  a  combination  from  numerous  schools,  thus  totals  across  sections  will  not  be  the  same. 
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REVIEWING  THE  MIDYEAR  PROGRESS  REPORT 


Although  the  Mid-Year  Progress  Report  was  developed  to  provide  data  to  be 
used  to  assess  whether  or  riot  the  Annual  Education  Plan  is  on  course,  these  data  can  be 
used  to  assess  school  needs  for  selected  systemwide  indicators. 

SYSTEMWIDE  INDICATORS 

The  following  are  points  that  refer  to  the  systemwide  indicators  provided  on 
page  one  of  the  Mid-Year  Progress  Report  (a  sample  page  follows  this  chapter;  see  Ap- 
pendix C:  Forms  for  a  copy  of  the  complete  form). 

1.  It  is  important  to  note  that  for  all  indicators,  the  first  column  spans  a  total  school 
year,  while  the  next  three  columns  are  for  the  first  half  year  only.  When  inter- 
preting any  half-year  data,  remember  that  the  ntimbers  by  mid  year  could  fluctu- 
ate from  year  to  year  even  though  the  overall  yearly  rate  for  the  indicator 
remains  constant.  Thus,  you  should  not  place  undue  importance  on  year-to-year 
differences  unless  there  is  other  corroborating  evidence. 

2.  Average  Student  Attendance  -  These  data  allow  the  school  to  compare  student 
attendance  figures  for  this  half  year  with  data  from  a  similar  period  for  the  pre- 
vious two  years.  These  data  allow  you  to  ask  questions  such  as: 

a.  Is  the  average  student  attendance  for  this  first  half  higher  than  what  it  was  at 
this  time  last  year  or  the  year  before? 

b.  Are  there  fewer  chronic  absentees  this  year  than  in  previous  mid-year 
periods? 

c.  Are  there  more  students  with  perfect  attendance  this  mid-year  than  in  prior 
mid-year  periods?  (Breakdown  of  attendance  numbers  are  available  only  for 
those  schools  which  use  the  on-line  Automated  Attendance  System). 

Potential  sources  for  misinterpretation.  Because  these  data  reflect  all  the  grades 
grouped  together  (e.g.,  1-5  for  elementary),  they  do  not  allow  you  to  identify  if  a 
problem  is  occurring  only  within  one  grade  (e.g.,  1st  grade).  Also  note  that  data 
for  the  subgroup  breakdown  (perfect  attendance,  absent  5  or  fewer  days,  etc.)  are 
not  available  for  years  prior  to  1990. 

3.  Suspensions  -  These  data  allow  schools  to  examine  how  their  suspension  rate 
for  this  half  year  compares  with  prior  similar  periods  and  with  last  year  overall. 
These  data  allow  schools  to  ask  questions  such  as: 

a.  Is  the  number  of  students  being  suspended  for  this  first  half  of  the  year 
similar  to  what  it  was  last  year  or  the  year  before? 
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If  the  number  is  high,  are  there  a  few  students  being  suspended  often  or  are  there 
many  students  being  suspended  only  once?  (Considerably  more  events  than  pu- 
pils indicates  that  a  few  students  are  being  suspended  repeatedly.) 
Potential  sources  for  misinterpretation.  The  caution  in  point  #1  above  applies  to  sus- 
pensions. That  is,  these  questions  should  be  addressed  carefully  because  the 
number  of  suspensions  by  mid  year  could  fluctuate  from  year  to  year  while  the 
overall  yearly  suspension  rate  remains  constant.  For  example,  one  year  the  ma- 
jority of  susper\sions  could  occur  during  the  first  half  of  the  year.  The  next  year 
the  majority  of  suspensions  could  occur  during  the  second  half  of  the  year,  but 
overall  there  could  be  the  same  number  of  suspensions  for  both  years.  For  ele- 
mentary schools,  because  suspension  nvunbers  are  so  small,  changes  from  year  to 
year  may  not  be  indicative  of  any  trend  and  thus  should  be  interpreted  with 
caution. 

4.  Annual  Dropout  -  This  indicator  applies  primarily  to  high  schools  although 
there  are  middle  school  level  dropouts.  The  dropout  figures  provide  one  per- 
spective on  the  school's  holding  power  and  allow  schools  to  ask  questions  such 
as:  were  there  fewer  students  dropping  out  during  the  first  half  of  this  year  as 
compared  with  the  first  half  of  last  year  or  the  year  before? 

Potential  sources  for  misinterpretation.  Because  these  numbers  reflect  only  those 
students  who  dropped  out  within  the  time  frame,  they  are  less  mearungful  than 
end-of-year  figures  (see  point  #1). 

5.  Special  Education  -  The  data  include  Special  Education  activity  regarding  the 
number  of  students  reviewed,  prototype  changes,  the  nvimber  of  new  referrals, 
and  a  breakdown  of  referral  sources.  The  number  of  students  reviewed  provides 
an  overview  of  SPED  activity  and  thus  serves  as  a  basis  for  analyzing  more  spe- 
cific SPED  activities.  Prototype  increases  and  decreases  can  be  monitored  with 
reference  to  similar  time  periods  across  several  years.  When  comparing  this 
mid-year  data  with  prior  years,  schools  should  bear  in  mind  that  the  numbers  for 
prototype  increase  or  decrease  for  the  first  half  of  the  current  school  year  period 
reflect  proposed  prototype  changes  irrespective  of  whether  or  not  the  plan  has 
been  signed.  These  data  allow  schools  to  ask  questions  such  as: 

a.  Is  the  number  of  students  being  reviewed  for  this  first  half  of  the  year  similar 
to  what  it  was  last  year  or  the  year  before? 

b.  Are  the  majority  of  prototype  changes  in  the  direction  of  mainstreaming? 

c.  What  is  the  percentage  of  new  referrals  with  pre-referral  not  waived? 

d.  From  where  are  the  bulk  of  the  new  referrals  coming,  i.e.,  from  parents  or 
from  the  school? 

e.  Are  the  referral  sources  changing  from  year  to  year? 
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Potential  sources  for  misinterpretation.  Note  that  there  are  certain  categories  of  spe- 
cial needs  that  are  less  likely  to  change  than  others;  this  could  affect  whether  or 
not  your  school  could  reasonably  expect  prototype  changes  to  move  downward. 

6.  Staff  Attendance  -  These  data  allow  schools  to  compare  average  staff  attendance 
for  this  half  year  with  data  from  a  similar  period  for  the  previous  two  years. 
Also,  as  with  student  attendance  data,  there  is  a  breakdown  of  the  average  atten- 
dance into  subgroups  to  allow  a  closer  analysis  of  a  possible  problem.  These 
data  allow  schools  to  ask  questions  such  as: 

a.  Is  the  average  staff  attendance  for  this  first  half  of  the  year  similar  to  what  it 
was  last  year  or  the  year  before? 

b.  Is  the  average  staff  attendance  rate  being  affected  by  a  few  staff  who  are 
chroriically  absent? 

Potential  sources  for  misinterpretation.  It  is  important  to  note  that  the  numbers  for 
the  half  year  data  will  tend  to  be  "better"  than  those  of  the  full  year  data  for  the 
first  two  rows  (absent  0-5  days)  because  it  is  easier  to  be  absent  only  5  or  fewer 
days  over  half  a  year  than  over  the  whole  year. 

SCHOOL  LEVEL  MEASURES  OF  SUCCESS 

The  following  are  points  that  refer  to  the  school  level  measvires  of  success  incor- 
porated into  the  Annual  Education  Plan  and  reproduced  on  page  three  of  the  Mid-Year 
Progress  Report  (a  sample  copy  of  form  can  be  found  in  Appendix  C:  Forms). 

1.  As  part  of  the  Mid- Year  Progress  Report,  each  school  reviewed  progress  on  their 
objectives  by  gathering  relevant  data  specified  by  the  measures  of  success  for 
each  objective.  These  data  can  be  useful  for  revealing  areas  of  need  to  be  ad- 
dressed by  the  Three- Year  Plan. 

2.  Available  data  may  be  in  the  form  of  attendance  logs  of  parents'  meetings,  teach- 
er reports  on  the  number  of  books  advanced  on  average  in  the  HBJ  basal,  sum- 
mary results  of  teacher  comments  about  at-risk  student  progress,  suirunary 
results  of  teacher  observations  of  social-emotional  growth,  etc. 

3.  These  data  should  be  reviewed  to  see  if  they  reveal  any  unexpected  results  by 
mid-year,  either  revealing  a  strong  achievement,  or  highlighting  an  area  that  ap- 
pears to  remain  problematic.  Ln  this  regard,  the  school  level  data  can  provide  a 
more  tailored  analysis  than  the  systemwide  indicators  for  identifying  specific 
problem  areas  or  potential  solutions  unique  to  the  school. 


BPSR&D  NA-10  6/1993 


Assessing  Needs  -  Using  Data  to  Review  School  Status 


REVIEWING  METROPOLITAN  ACHIEVEMENT  TEST  DATA 

Metropolitan  Achievement  Test  data  can  be  exaniined  to  assess  achievement 
needs  for  reading  and  mathematics.  There  are  several  sources  of  MAT6  data:  the  Re- 
ceiving School  Report  with  the  median  percentiles  by  race  by  grade  for  students  in  the 
school  this  year  based  on  scores  from  last  spring  (available  upon  request  in  the  fall);  the 
AWC  MATS  Report  for  grades  3,  4  and  5  conducted  during  the  past  fall  (mailed  to 
schools  in  January);  the  MAT6  graphs  in  School  Profiles;  and  the  Individual  Student  Report 
(mailed  to  schools  in  September).  (Sample  copies  of  the  Receiving  School  Report,  Indi- 
vidual Student  Report,  and  School  Profiles  MAT6  data  page  are  presented  at  the  end  of 
this  chapter) 

USING  THE  RECEIVING  SCHOOL  REPORTS' 

1.  These  reports  contain  two  major  types  of  information: 

a.  Median  percentiles  for  each  grade  as  a  whole  and  broken  down  by 
racial /ethnic  group; 

b.  The  number  of  students  scoring  within  certain  score  ranges  (below  the  21st 
percentile,  21-30,  31-40,  41-50,  51-60,  and  above  the  60th  percentile)  broken 
down  by  racial /ethnic  group. 

2.  The  report  summarizes  results  for  all  students  currently  in  your  school  who  took 
the  test  last  spring  and  are  now  classified  as  either  regular  education,  special 
education  with  .1  or  .2  prototypes  or  bilingual  education  in  steps  4  or  5.  All  other 
students  are  excluded  from  this  report.  This  is  important  to  note  particvilarly 
when  considering  needs  of  special  education  students  with  prototypes  higher 
than  .2  or  bilingual  program  students  on  steps  lower  than  3. 

3.  The  following  kinds  of  questions  can  be  addressed  by  examining  the  median  per- 
centiles and  frequencies: 

a.  Is  the  typical  student  performance  in  reading  or  mathematics  about  grade 
level  (50th  percentile)  for  each  grade? 

b.  Are  there  differences  across  racial/ethnic  groups? 

c.  What  percent  of  students  (in  the  reporting  population)  scored  at  or  below  the 
50th  percentile^  the  30th  percentile,  above  the  60th  percentile?  How  do  these 
percentages  vary  by  racial /ethnic  group? 

d.  Are  there  certain  grades  that  need  more  attention /resources  than  other 
grades?  Are  there  certain  racial /ethnic  groups  within  certain  grades  that 
need  more  attention  than  other  groups? 

'  These  reports  can  be  identified  by  examining  the  Date  of  Testing  and  Date  of  Analysis  near  the  top  of 
the  printout.  The  Date  of  Testing  is  May  of  the  previous  school  year  and  the  Date  of  Analysis  is 
September  of  the  current  school  year. 

^  The  percent  of  students  scoring  at  or  below  the  50th  percentile  is  calculated  by  adding  the  number  of 
students  below  the  21st,  21-30, 31-40,  and  41-50th  colunms  and  dividing  by  the  Total  Students. 
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4.  If  a  certain  grade  has  a  particularly  low  median  percentile  or  a  high  number  of 
students  scoring  below,  say,  the  30th  percentile,  the  school  team  can  turn  to 
teachers  in  those  grades  to  identify  those  students  and  provide  their  Individual 
Student  Rqjorts.  These  diagnostic  reports  can  be  used  to  see  if  there  are  common 
areas  of  deficiency  that  need  to  be  addressed  for  the  lower  scoring  students. 


USING  THE  AWC  MAT6  REPORT 

1.  This  report  can  be  used  in  the  same  way  as  the  Receiving  School  Report.  It  should 
be  used  for  students  in  grades  3, 4  and  5  because  it  provides  the  most  up-to-date 
achievement  information  on  this  group. 


USING  MAT6  DATA  IN  SCHOOL  PROFILES 

1.  The  graphs  in  School  Profiles  provide  longitudinal  svtmmary  data  for  each  grade.  This 
presents  a  different  perspective  on  student  achievement  with  respect  to  the  needs  asses- 
sment process.  The  Receiving  School  Report  provides  information  about  the  students  in 
your  school  now  and  what  their  needs  are,  whereas  School  Profiles  MAT6  graphs  provide 
information  about  school  performance  by  grade  over  time. 

2.  Some  questions  that  may  be  addressed  are: 

a.  Are  there  any  grades  that  always  seem  to  do  well?  Next,  explore  with  those  teachers 
what  works  and  why.  Successful  strategies  should  be  shared. 

b.  Are  there  any  grades  that  consistentiy  perform  less  well?  Next,  explore  with  those 
teachers  what  the  causes  may  be. 

OTHER  ISSUES  TO  CONSIDER 

1.  MAT6  test  scores  are  not  the  only  indicators  of  reading  and  mathematics  achievement. 
In  some  cases,  for  some  groups  of  students,  they  may  not  even  be  the  best  indicators. 
Performance  assessment,  teacher  observations,  and  checklists  are  alternative  indicators 
of  achievement  that  should  be  investigated. 

2.  The  MAT6  Receiving  School  Report,  AWC  Report,  and  School  Profiles  data  do  not  include 
Special  Education  students  with  prototypes  higher  than  .2  or  BUingual  program  stu- 
dents with  Steps  lower  than  3.  However,  some  of  these  students  may  have  taken  the 
Metiopolitan  Achievement  Tests  and  the  school  may  have  their  Individual  Student  Re- 
ports available  for  examination  individually. 

3.  Individual  student  results  can  vary  quite  a  bit  from  year  to  year  due  to  non-achievement 
related  reasons  (poor  night's  sleep,  family  problems,  etc.).  Thus  whenever  possible,  data 
for  an  individual  student  should  include  multiple  years  and  multiple  test  sources 
(D.R.P.,  C.R.T.'s,  etc.).  Individual  performance  fluctuations  are  generally  not  a  problem 
when  looking  at  aggregated  data,  (e.g.,  grade  median  percentiles)  if  the  number  of  stu- 
dents in  the  grade  is  not  very  small. 
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THE  CURRENT  EDUCATIONAL  PLAN  DOCUMENT 

The  current  Three- Year  Plan  document  can  provide  a  very  useful  starting  point 
for  a  Year  Two  or  Year  Three  needs  analysis  or  the  needs  analysis  for  a  new  three-year 
cycle.  By  examining  the  school's  current  educational  plan  dociunent,  staff  can  obtain  in- 
formation that  is  relevant  to  identifying  needs,  establishing  goals  and  objectives,  and 
developing  an  action  plan.  While  each  school's  plan  and  current  status  are  different, 
the  issues  that  have  been  addressed  to  date  in  developing  and  implementing  the  plan 
are  relevant  to  this  next  three  year  cycle.  Issues  regarding  the  school's  status  vis-a-vis 
the  current  Educational  Plan  are  discussed  in  the  section  titled  "Using  Existing  Data  to 
Review  School  Status:  Reviewing  the  Mid-Year  Progress  Report".  Some  relevant  ques- 
tions are  listed  below. 

IDENTIFYING  NEEDS 

1.  Within  each  of  the  Superintendent's  Priority  areas,  do  the  areas  of  focus  coincide 
with  the  school  community's  mission  or  vision  of  where  they  wanted  to  be  at  the 
end  of  the  school  year? 

If  not,  what  would  have  been  more  appropriate  areas  of  focus? 

2.  Within  each  of  the  Superintendent's  Priority  areas,  are  the  areas  targeted  for  in- 
tervention this  year  those  with  the  greatest  need? 

If  not,  what  would  have  been  more  appropriate  areas  of  focus? 

3.  Are  the  identified  needs  specific  enough  in  terms  of  the  area(s)  and  the  individu- 
als/groups to  be  targeted?  If  not,  what  would  have  been  a  more  useful  descrip- 
tion of  the  target  areas  and /or  target  groups? 

ESTABLISHING  GOALS  AND  OBJECTIVES 

1.  Within  each  of  the  Superintendent's  Priority  areas,  are  the  objectives  substantial 
enough  to  be  worthy  of  concerted  effort  yet  feasible  enough  that  they  are  likely 
to  be  achieved  this  year?  If  not,  why  not,  and  how  could  they  be  improved? 

2.  Do  the  objectives  adequately  encompass  the  school's  need(s)  within  the  priority 
area? 

If  not,  why  not  and  how  could  they  be  improved? 

3.  Do  the  measures  of  success  adequately  reflect  the  change  which  was  envisioned 
within  the  objectives? 

If  not,  why  not  and  how  could  they  be  improved? 

4.  If  the  objectives  are  achieved,  will  the  target  area  still  be  an  area  of  great  need 
during  the  next  three  years? 
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IMPLEMENTING  THE  PLAN 

1.  Within  each  of  the  Superintendent's  Priority  areas,  are  the  action  steps /activities 
adequate  for  achieving  the  stated  objective?  If  not,  why  not,  and  how  could  they 

be  improved? 

2.  Have  the  activities /action  steps  been  implemented  as  planned  by  all  relevant 
staff,  or  has  implementation  been  inconsistent? 

3.  If  implementation  has  been  inconsistent,  why  has  that  happened  and  how  can 
implementation  be  improved? 

4.  On  the  basis  of  evidence  to  date,  do  the  planned  activities  (or  substituted  activi- 
ties) appear  to  be  contributing  to  the  achievement  of  the  stated  objective(s)? 

If  not,  why  not,  and  what  alternative  activities  could  be  pursued  between  now 
and  the  end  of  the  school  year  in  order  to  achieve  the  objective(s)? 
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OTHER  DATA  SOURCES 

In  addition  to  the  existing  systemwide  data  sources,  there  are  other  important 
sources  of  data  within  each  school.  These  data  sources  include  teachers'  records,  stu- 
dent grades  and  portfolios,  observations  in  classrooms  and  other  settings,  surveys  and 
interviews  of  parents,  staff,  and  in  some  cases  students,  and  formal  and  informal  group 
discussions  or  interviews.  While  it  can  take  considerable  effort  to  collect,  analyze  and 
summarize  these  school-based  data,  the  resulting  information  can  be  extremely  valu- 
able for  at  least  three  reasons: 

1.  the  information  is  tailored  to  the  school's  information  needs; 

2.  the  information  is  'current';  and 

3.  since  the  information  is  derived  from  the  school  community  itself,  it  will 
be  believable  and  consequently  it  will  help  to  motivate  staff  to  move  in  the 
same  direction  to  fulfill  the  Three- Year  Plan. 

Each  data  source  has  certain  advantages  and  disadvantages.  Some  of  these  key 
issues  are  listed  below. 


TEACHERS'  RECORDS 

The  records  maintained  by  classroom  teachers  can  be  a  rich  source  of  data  about 
both  students  and  curriculum  and  instruction.  Student  data  may  include  attendance 
and  tardiness,  performance  on  various  classroom  tests,  homework,  class  participation, 
and  classroom  behavior.  Curriculum  and  instruction  data  may  include  lessons  covered, 
problems  encountered,  innovative  approaches  or  materials  used,  etc.  Where  the  issues 
of  interest  to  the  Three- Year  Plan  may  include  changes  in  classroom  instruction,  teach- 
ers' records  are  a  valuable  source  of  data. 

If  teachers  have  not  anticipated  sharing  these  materials  with  others,  there  may  be 
some  resistance  to  this  idea.  Ideally,  in  developing  its  plan,  a  team  should  anticipate  the 
need  for  access  to  teachers'  records  and  make  sure  that  teachers  are  aware  of  the  impor- 
tance of  and  need  for  the  information.  Another  potential  problem  is  that  variations  in 
record-keeping  style  may  make  comparisons  across  classroonis  difficult  and  therefore 
make  these  data  hard  to  summarize.  One  possible  solution  is  to  have  teachers  summa- 
rize their  own  records  in  a  consistent  format,  focusing  only  on  the  questions  of  direct  in- 
terest and  providing  only  the  most  relevant  information.  This  may  require  the 
development  of  a  simple  form  to  be  completed  by  all  relevant  staff. 
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STUDENTS'  GRADES  AND  PORTFOLIOS 

Classroom  performance  indicators  provide  both  an  ongoing  and  the  most  cur- 
rent picture  of  students'  progress  and  achievement.  Grades  on  classroom  tests,  clas- 
sroom participation,  and  homework  are  a  handy  way  to  summarize  information  about 
performance  and  achievement.  Portfolios  permit  the  examination  of  more  fine  grained 
information  about  the  students.  Consistent  low  test  grades  may  indicate  a  student  who 
is  falling  further  and  further  behind  or  a  student  who  consolidates  new  learning  at  a 
slightly  slower  rate  than  other  students  but  eventually  catches  up.  To  differentiate  be- 
tween these  two  types  of  students,  portfolio  assessment  has  the  potential  to  provide  a 
rich  and  focused  picture  of  a  student's  strengths  and  weaknesses. 

As  with  teachers'  records,  the  most  efficient  way  to  obtain  this  information  is  to 
develop  a  simple  form  which  specifies  the  information  that  teachers  are  to  provide.  It  is 
not  necessary  for  a  teacher  to  provide  information  about  all  students  in  the  class.  One 
approach  is  to  ask  for  basic  information  about  grades  or  other  performance  for  all  stu- 
dents and  then  to  ask  for  more  detailed  information  about  a  smaller  group  of  students. 
The  smaller  group  could  be  randomly  selected  or  intentionally  selected  to  represent  a 
certain  group  of  students,  e.g.,  students  who  are  doing  well  or  doing  poorly,  students 
with  a  unique  skill  or  problem,  the  'typical'  student,  etc. 

OBSERVATIONS  IN  CLASSROOMS  AND  OTHER  SETTINGS 

Systematic  classroom  observation  can  be  a  time  consuming  activity  but  it  can 
also  offer  a  unique  perspective  on  important  questions.  The  sin\ultaneous  advantage 
and  disadvantage  of  classroom  observation  is  that  it  is  typically  done  by  someone  other 
than  the  classroom  teacher.  The  primary  advantage  is  that  the  observer  brings  a  fresh 
set  of  eyes  and  ears  to  the  classroom.  Furthermore,  if  the  same  person  observes  a  num- 
ber of  classes,  there  ought  to  be  more  consistency  in  findings  across  classrooms  than  if 
each  teacher  reported  on  his/her  own  classroom.  The  disadvantages  include  the  costs 
in  time  and  financial  resources  needed  to  train  the  observer(s)  and  to  have  them  do  the 
observatioris.  Furthermore,  some  teachers  are  hesitant  about  having  an  'outsider'  ob- 
serve in  their  classroom. 

Observations,  formal  or  informal,  in  settings  other  than  the  classroom  also  may 
be  useful.  For  example,  if  school  climate  might  be  a  concern,  observations  could  be 
done  in  the  hallways,  assemblies,  the  lunchroom,  and  at  the  begirming  and  end  of  the 
school  day. 

Unfocused  observations  are  likely  to  lead  to  collecting  too  much  data  and  the 
risk  of  being  overwhelmed  and  therefore  unable  to  discern  the  most  important  trends. 
An  observation  that  is  too  narrowly  defined  or  too  short  is  likely  to  miss  the  relevant 
data.  Appendix  A  contains  an  extended  discussion  of  observational  techniques,  includ- 
ing approaches  for  recording  and  summarizing  data. 

BPSR&D  NA-16  6/1993 


Assessing  Needs  -  Using  Data  to  Review  Sciiool  Status 


While  the  potential  rewards  are  great,  careful  planiung  needs  to  be  done  before  a 
school  commits  itself  to  trying  to  obtain  observational  data  for  the  needs  analysis. 
However,  it  might  be  worthwhile  to  consider  and  plan  for  observational  approaches  as 
a  part  of  future  needs  analyses  or  for  data  collection  in  another  phase  of  the  Three- Year 
cycle. 

SURVEYS  AND  INDIVIDUAL  INTERVIEWS 

A  well  designed  survey  is  an  efficient  means  of  obtaining  information  from  a 
large  number  of  people.  However,  care  must  be  taken  in  the  design  of  the  survey  to  en- 
sure that  the  responses  to  the  survey  will  provide  the  data  that  are  relevant  to  the  needs 
analysis.  The  wording  of  the  items  must  be  clear  and  should  guide  the  person  to  make 
the  type  of  response  which  will  provide  useful  data.  In  addition  to  helping  with  the 
process  of  identifying  needs,  surveys  can  be  used  to  help  prioritize  needs.  Thus,  re- 
spondents can  be  asked  to  rank  order  various  needs  or  potential  approaches  to  address- 
ing the  needs.  (Samples  of  svirveys  are  in  Appendix  A:  Surveys.  Samples  of  other 
surveys  are  available  from  the  Office  of  Research  and  Development.  Appendix  A  also 
contains  a  review  of  available  survey  measures  and  a  number  of  guidelines  for  con- 
structing surveys.) 

Individual  interviews  provide  an  effective  alternative  to  written  surveys  as  a 
means  to  obtaining  information  for  the  needs  analysis.  Interviews  can  be  used  in  con- 
junction with  surveys  both  before  and  after  the  survey  is  administered.  Interviewing 
before  the  survey  is  developed  can  provide  useful  information  about  what  should  be  in- 
cluded or  excluded  from  the  survey.  Follow-up  interviewing  can  be  done  to  obtain 
more  detailed  information  about  the  topic. 

As  with  surveys,  a  good  interview  must  be  developed  with  care.  While  the  prob- 
lem with  misunderstanding  items  is  minimized  with  interviews,  the  interviewer  must 
be  skilled  at  making  the  interviewee  feel  comfortable.  Furthermore,  the  interviewer 
must  avoid  cutting  off  the  respondent  or  answering  for  the  respondent.  Given  the  time 
commitment  needed  to  conduct  individual  interviews,  they  should  be  used  sparingly 
for  the  needs  analysis.  Appendix  A  contains  some  guidelines  for  interviewing  and  rec- 
ommendations for  how  to  record  interview  data. 

GROUP  DISCUSSIONS  OR  INTERVIEWS 

In  many  ways  group  discussions  are  the  most  efficient  way  to  obtain  rich  data  for 
the  needs  analysis.  In  a  context  where  individuals  rarely  get  a  chance  to  discuss  these 
issues  as  a  group,  this  method  of  data  collection  can  also  contribute  to  the  formation  of 
a  positive  group  identity  which  is  very  useful  to  a  plan's  development  and  implementa- 
tion. 
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While  either  unstructured  or  structured  group  discussions  could  be  used,  struc- 
tured discussions  are  both  the  most  efficient  and  the  most  likely  to  give  everyone  an  op- 
portunity to  be  heard.  The  leader  of  a  group  discussion  should  be  skilled  at  both 
moving  the  discussion  along  and  giving  everyone  a  chance  to  talk.  The  questions  to  be 
posed  to  the  group  should  include  both  items  which  elicit  general  group  discussion  and 
items  which  focus  the  group  on  specific  issues  that  need  to  be  addressed  and /or  re- 
solved. As  noted  above,  the  section  on  interviewing  in  Appendix  A  contains  some  help- 
ful considerations  for  designing  and  conducting  interviews. 

Group  composition  is  another  issue  to  consider.  In  many  cases  it  is  best  to  in- 
clude people  with  similar  interests  and  concerns  within  a  group.  This  allows  for  the 
fullest  expression  of  a  narrow  range  of  issues.  Thus,  within  a  large  school,  groups  may 
be  composed  on  the  basis  of  the  grade  levels  taught,  e.g.,  K  -  2  and  3-5,  rather  than 
mixing  across  the  school's  grade  span. 

Finally,  there  needs  to  be  some  type  of  form  developed  in  order  to  collect  the  in- 
formation efficiently.  Consideration  needs  to  be  given  to  the  process  so  that  the  means 
of  recording  the  information  is  easy  to  use.  Appendix  A  provides  some  suggestions. 
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Summarizing  Data  Collected  in  Preparation  for 
Selecting  and  Prioritizing  Needs 

The  Needs  Analysis  phase  often  involves  the  collection  of  data  from  numerous 
sources  including  survey  responses  from  parents  and  teachers,  student  performance  in- 
dicators based  on  course  grades  and  Metropolitan  Achievement  Tests,  and  comments 
from  group  sessions.  Obtaining  data  from  numerous  sources  is  important  for  identify- 
ing and  prioritizing  needs  because  there  are  many  ways  to  define  the  school's  current 
status  and  many  different  perspectives  on  the  ideal  status  or  vision. 

While  these  different  perspectives  are  important,  they  also  make  it  difficult  to 
present  a  coherent  picture  of  a  school's  current  needs.  A  careful  process  of  summariz- 
ing the  data  should  provide  information  about  patterns  that  emerge  while  preserving 
information  about  meariingful  differences  among  groups  and  data  sources. 

CATEGORIES 

The  first  step  in  summarizing  the  data  is  to  establish  'categories'.  This  should  be- 
gin before  the  data  are  collected  and  therefore  help  to  guide  the  design  of  data  collec- 
tion instruments,  whether  they  are  surveys,  classroom  observation  checklists,  or 
pre-existing  student  performance  indicators.  Categories  are  usually  designed  to  cap- 
ture data  about  'topics'  and /or  'intensity'. 

Topical  categories  can  be  broad  subject  areas,  e.g.,  reading,  mathematics,  and  sci- 
ence, or  more  narrowly  defined  areas  within  an  academic  subject  such  as  phonics  skills, 
vocabulary  knowledge,  or  comprehension.  Topical  categories  can  also  cover  grade  lev- 
els, time  periods,  e.g.,  'last  year'  and  'this  year',  or  groups  of  students.  Categories  can 
incorporate  more  than  one  topic  such  as  academic  performance  by  grade  level  and  in- 
terpersonal skills  by  grade  level. 

Intensity  categories  provide  a  way  to  classify  data  numerically.  On  an  opinion 
survey,  intensity  categories  could  be  'strongly  agree',  'agree',  'disagree'  and  'strongly 
disagree'.   Looking  at  course  grades,  intensity  categories  would  be  the  specific  grades, 
'A',  'B',  etc. 

The  two  key  features  of  both  types  of  categories  are  that  they  are  'exhaustive' 
and  'mutually  exclusive'.  If  the  categories  are  not  exhaustive  then  there  will  be  data 
that  cannot  be  classified.  For  example,  parents  may  be  asked  in  a  short  answer  item  to 
describe  what  could  be  improved  about  their  child's  school.  If  the  categories  available 
for  classifying  the  responses  were  'classroom  features'  and  'building  features',  the  sur- 
vey coders  would  have  difficulty  classifying  the  following  response:  'No  desirable 
middle  school  for  my  child  once  she  leaves  here.'  Typically,  a  category  labeled  'Other'  is 
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used  to  handle  responses  that  do  not  fit  within  other  categories.  However,  if  too  much 
data  go  into  the  "Other'  category,  some  useful  information  may  be  overlooked. 

In  addition  to  being  exhaustive,  categories  should  not  overlap.  If  teachers  are  to 
identify  grade  levels  where  extra  resources  are  needed,  categories  such  as  the  following 
can  be  confusing  to  both  the  respondent  and  those  who  have  to  interpret  the  results  - 
'1st',  '2nd  and  3rd',  '3rd',  '2nd  through  4th'  and  '4th'.  If  the  aim  is  to  allow  respondents 
to  select  more  than  one  grade  level,  it  would  be  better  to  list  each  one  separately  and 
have  them  either  rank  order  them  or  just  check  off  as  many  levels  as  they  feel  are  in 
need  of  the  resources. 

Beyond  the  requirement  that  categories  be  exhaustive  and  mutually  exclusive, 
there  is  the  more  subtle  task  of  defining  the  categories  such  that  the  'important  and  use- 
ful' distinctions  are  made.  Basically,  meaiungful  and  useful  categories  'emerge'  over 
time  as  staff  both  bring  their  experience  and  expertise  to  the  task  and  as  the  data  are  're- 
visited' when  staff  try  to  go  from  the  categorized  responses  to  analyzing  and  interpret- 
ing the  results.  Thus,  categories  that  are  too  broad  will  not  be  useful  as  a  guide  for 
developing  the  Goals  and  Objectives  or  the  Action  Plan.  Categories  that  are  too  narrow 
will  make  it  difficult  to  arrive  at  corisensus. 

ORGANIZING  THE  DATA 

The  data  should  be  organized  to  provide  information  about  similarities  and  dif- 
ferences among  different  sources  of  data.  The  most  direct  way  of  doing  this  is  to  pres- 
ent the  percentages  across  categories  for  each  data  source.  Thus,  if  the  intent  is  to 
identify  the  curriculum  subject  area  with  the  greatest  need,  for  each  subject  area 
(category)  the  percentage  of  parents  who  gave  it  the  highest  ranking,  the  percentage  of 
teachers  who  gave  it  the  highest  ranking,  and  the  percentage  of  students  getting  grades 
of  'D'  or  lower  can  be  presented.  When  using  percentages  caution  should  be  exercised  if 
the  total  number  is  small.  For  example,  if  there  are  only  four  respondents,  a  difference 
of  one  person  changes  the  percentage  within  a  category  by  25  percentage  points. 

In  addition  to  showing  the  entire  distribution  of  the  data,  it  is  often  useful  to 
highlight  the  most  typical  response  or  level  of  performance.  Various  summary  statistics 
such  as  the  mean,  median,  or  mode  can  be  used  to  do  this.  These  summary  statistics  are 
generally  most  useful  with  categories  that  represent  intensity.  Please  refer  to  Appendix 
B:  Statistical  Procedures,  for  an  explanation  of  these  terms  and  the  computational 
formulas. 

Another  way  to  present  the  data  is  to  show  how  far  away  the  current  status,  e.g., 
survey  responses  from  parents  or  MAT6  scores,  is  from  the  target  or  vision.  This  can  be 
done  graphically  or  in  a  table  showing  'difference'  scores. 

The  following  worksheet  is  provided  to  help  summarize  findings  and  needs. 
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NEEDS  ANALYSIS  WORKSHEET  (Optional) 


Instructions: 


This  worksheet  is  provided  to  assist  in  the  data  analysis  process.  For  the  purpose  of  this  Work- 
sheet, five  Needs  Categories  are  identified:  Academic  Performance,  Discipline /Attendance,  Teacher  Per- 
formance/Morale, Integration  SPED/  Bilingual,  and  Involvement  of  Parents.  For  each  category,  needs 
should  be  identified.  For  example,  a  number  of  schools  have  developed  parent  and  student  surveys. 
From  these  surveys,  iriformation  about  academic  performance  and  Bilingual  integration  might  be  ob- 
tained. This  information  should  be  analyzed  and  the  findings  enumerated  in  the  section  "FINDINGS"  for 
each  Need  Category.  From  the  findings,  one  or  more  needs  wiU  be  identified  which  should  be  listed  in 
the  section  "NEEDS". 

Once  all  data  sources  have  been  analyzed,  and  all  needs  have  been  identified,  the  list  of  needs 
must  be  assigned  to  one  of  the  four  Superintendent's  priorities  and  also  priorihzed.  It  is  important  to 
make  the  distinction  between  Needs  and  Programs /Action  Steps.  Needs  target  the  areas  that  require 
strengthening.  For  example,  parents  may  perceive  that  the  children  need  better  reading  skills.  The  strate- 
gy to  make  the  children  improve  in  reading  is  different  from  the  need.  The  development  of  these  strate- 
gies belong  to  the  next  phase  —  developing  your  Three- Year  Plan  (Goals,  Objectives,  Action  Plans). 

Academic  Performance 


DATA  SOURCE  or  SOURCES:  

(E.g.,  SY90-91  School  Profiles,  Metropolitan  Achievement  Test  Data,  Mid  Year  Progress  Report  System- 
wide  Indicators  Printout,  Parent  or  Student  Survey,  Teacher  Observations,  Student's  Grades  and  Portfo- 
lios, Administrator  Observations) 


FINDINGS: 

NEEDS: 
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Discipline/Attendance 


DATA  SOURCE  or  SOURCES: 

(E.g.,  SY90-91  School  Profiles,  Metropolitan  Test  Data,  Mid  Year  Progress  Report  Systemwide  Indicators 
Printout,  Parent  or  Student  Survey,  Teacher  Observations,  Student's  Grades  and  Portfolios,  Administra- 
tor Observations) 


FINDINGS: 

NEEDS: 

Teacher  Performance/  Morale 


DATA  SOURCE  or  SOURCES: 


FINDINGS: 

NEEDS: 
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Integration  SPED/  Bilingual 


DATA  SOURCE  or  SOURCES:  

(E.g.,  SY90-91  School  Profiles,  Metropolitan  Test  Data,  Mid  Year  Progress  Report  Systemwide  Indicators 
Printout,  Parent  or  Student  Survey,  Teacher  Observations,  Student's  Grades  and  Portfolios,  Administra- 
tor Observations) 


FINDINGS: 

NEEDS: 

r 

Involvement  of  Parents 


DATA  SOURCE  or  SOURCES: 


FINDINGS: 

NEEDS: 
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Procedures  for  Selecting  and  Prioritizing  Needs 

The  group  responsible  for  obtaining  and  organizing  information  for  the  needs 
analysis  will  also  have  to  decide  how  to  present  it  to  the  larger  school  community. 
There  are  many  approaches  to  prioritizing  needs,  ranging  from  a  unilateral  decision  by 
the  principal  or  headmaster  through  a  strict  quantitative  assessment  to  a  group  consen- 
sus. For  school  settings,  procedures  which  use  group  decision-making  based  on  the 
group's  examination  of  a  common  core  of  relevant  information  are  the  most 
appropriate. 


mg: 


The  'report'  whether  it  be  written  or  presented  orally,  should  include  the  follow- 

1.  a  brief  description  of  the  data  sources  including  warnings  about  potential 
shortcomings  of  the  data,  e.g.,  limited  retioms  from  a  survey  to  parents  of 
students  in  the  upper  grades  or  more  detailed  data  needed  in  a  certain 
area. 

2.  information  about  the  target  level(s)  or  vision(s)  from  the  major 
stake-holding  groups,  e.g.,  parents,  teachers,  administrators,  students,  etc. 
In  some  cases  it  will  be  necessary  to  divide  these  larger  groups  into 
smaller  groups  based  on  relevant  characteristics  of  the  sub-groups,  e.g.. 
Bilingual,  Special,  and  Regular  education  teachers. 

3.  status  information  for  the  target  groups  based  on  the  available  data 
sources. 

Time  should  be  provided  for  review  and  discussion  of  these  data  by  the  entire 
decision-making  group.  While  it  is  possible  that  the  data  will  point  in  a  very  clear  and 
well  focused  direction,  it  is  more  likely  that  the  picture  will  be  more  complex.  The  dis- 
cussion should  serve  to  clarify  and,  in  some  cases,  amplify  the  various  points  raised  by 
the  data.  Some  points  to  consider  during  the  discussion  include  an  examination  of  the 
feasibility  of  successfully  addressing  the  various  needs  and  the  scope  of  the  interven- 
tions that  will  be  required  to  meet  the  needs.  The  data  or  perhaps  the  group  discussion 
may  indicate  that  there  is  no  common  vision  within  the  priority  area.  If  this  is  the  case, 
time  will  have  to  be  allocated  for  the  school  community  to  develop  a  vision  that  is  suffi- 
ciently broad  to  accommodate  the  various  constituencies. 

After  the  data  have  been  reviewed  and  discussed,  if  a  clear  consensus  is  not  evi- 
dent, the  group  can  conduct  a  preliminary  vote  to  rartk  order  the  various  options.  Table 
#1  shows  one  method  for  tabulating  the  rankings  (Method  A).  After  the  results  from 
the  preliminary  vote  have  been  noted  and  discussed,  if  a  consensus  has  still  not 
emerged,  a  final  vote  should  be  taken  to  rank  order  the  needs  (Table  #1  -  Method  B). 
The  top  ranked  needs  will  become  the  basis  for  the  development  of  the  Three- Year  Plan. 
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High 

Medium 

Low 

Total 

Priority 

Priority 

Priority 

Points 

6 

2 

2 

(6*3) 

(2*2) 

(2*1) 

24 

1 

8 

1 

(1*3) 

(8*2) 

(1*1) 

20 

0 

10 

0 

(0*3) 

(10*2) 

(0*1) 

20 

3 

3 

4 

(3*3) 

(3*2) 

(4*1) 

19 

The  number  of  needs  that  actually  get  addressed  in  the  plan  will  depend  on  the  scope 
and  complexity  of  the  identified  needs. 

Table  #1 
Two  Methods  for  Ranking  School  Needs 
Method  A 

Within  the  set  of  options,  each  person  should  select  the  10  most  important  needs 
and  rate  them  as  low,  medium,  or  high  priority.  Each  high  rating  is  worth  3  points,  each 
medium  ranking  is  worth  2  points  and  each  low  ranking  is  worth  1  point. 
Need 

A.  Reading  -  Comprehension 
(Grades  1  -5) 

B.  Reading  -  Basic  Skills 
(Grades  3  and  4) 

C.  Mathematics  -  Basic  Skills 
(Grades  1  -  2) 

D.  Science 
(Grades  3-5) 

Note  that  Need  B  would  receive  a  higher  ranking  than  Need  C  because  even  though  the  to- 
tal points  were  the  same,  20,  Need  B  had  more  'High"  ratings  than  Need  C. 

Method  B 

With  the  set  of  options,  each  person  should  rank  the  needs  from  low  to  high  with 
low  =  1  and  high  =  to  the  total  number  of  options  (4  in  this  example). 

Rankings 

Need  Highest 

1st 

A.  Reading  -  Comprehension  2 
(Grades  1  -5)  (2*4) 

B.  Reading  -  Basic  Skills  3 
(Grades  3  and  4)  (3*4) 

C.  Mathematics  -  Basic  Skills  4 
(Grades  1  -  2)  (4*3) 

D.  Science  1 
(Grades  3  -  5)                                         (1*4) 

Note  that  Method  B  yields  different  rankings  in  Total  Points  than  Method  A.  This  is  be- 
cause Method  B  forces  everyone  to  give  one  Need  the  highest  and  one  Need  the  lowest 
ranking.  Method  B  is  most  appropriate  when  a  final  decision  has  to  be  made  and  when 
only  certain  options  can  be  included. 
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2nd 

3rd 

Lowest 
4th 

Total 
Points 

4 

(4*3) 

2 

(2*2) 

2 

(2*1) 

26 

3 

(3*3) 

3 

(3*2) 

1 

(1*1) 

27 

3 

(3*3) 

3 
(3*2) 

0 

(0*1) 

27 

0 
(0*3) 

2 
(2*2) 

7 
(7*1) 

15 

Assessing  Needs  -  Documenting  Findings  and  Recommendations  from  the  Needs  Assessment 

REPORTING 

Documenting  Findings  and  Recommendations 

From  the  Needs  Assessment 


The  needs  analysis  can  be  viewed  as  both  a  process  and  a  product.  Up  to  this 
point,  it  has  been  viewed  as  a  process  by  which  a  school  community  examines  itself  and 
makes  a  decision  about  future  directions.  As  a  product  the  data  collected  for  the  needs 
assessment  phase  can  serve  as  a  guide  for  developing  the  plan  itself  and  as  a  baseline 
record  for  future  Three- Year  Plans. 

At  the  minimum,  the  Needs  Assessment  document  needs  to  indicate  the  data 
sources  used,  the  major  findings,  and  the  decisions  made  regarding  the  identified 
needs.  Appendix  C:  Forms  contains  a  copy  of  the  Needs  Assessment  form  to  be  com- 
pleted and  submitted  as  part  of  the  Three- Year  Educational  Plan.  Although  not  a  for- 
mal part  of  Years  Two  and  Three  plarming,  this  form  is  useful  as  preparation  for 
drawing  up  Action  Plans  for  these  parts  of  the  Three- Year  cycle  as  well. 

For  the  school  itself,  the  wealth  of  data  collected  for  the  Needs  Analysis  should 
be  summarized  and  shared  with  the  school  community  in  written  format.  The  previous 
section  of  this  Guide,  'Procedures  for  Selecting  and  Prioritizing  Needs',  listed  some  of 
the  information  that  should  be  shared  with  the  school  commimity  at  that  time.  As  dis- 
cussions regarding  the  objectives  and  activities  for  the  Three- Year  Plan  occur,  data  col- 
lected for  the  needs  assessment  may  be  consulted  repeatedly  as  new  and  more  detailed 
questions  are  asked  about  the  data. 

Data  collected  for  the  needs  assessment,  especially  survey  data,  can  be  used  as  a 
baseline  for  measuring  progress  in  certain  areas.  If  a  survey  is  used  to  document  the 
amount  of  time  parents  are  spending  with  their  children  on  school  related  tasks,  it  may 
be  possible  to  use  these  data  to  assess  the  impact  of  activities  designed  to  increase  par- 
ent involvement. 

Finally,  while  the  Needs  Analysis  process  tends  to  dwell  on  deficits  rather  than 
strengths,  the  needs  assessment  itself  may  reveal  many  areas  of  strength.  These 
strengths  should  be  noted  with  acknowledgements  to  the  staff  and  shared  with  parents 
and  others  who  want  to  know  about  the  school.  Whenever  feasible,  these  areas  of 
strength  should  be  used  as  the  basis  for  addressing  areas  of  need. 
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Next  Steps:  Moving  from  the  Needs  Analysis  to  a 

Plan  of  Action 


A  well  executed  Needs  Analysis  will  provide  a  school  with  a  good  start  on  the 
development  of  the  Three- Year  Plan  or  the  Action  Plans  for  Years  Two  and  Three.  The 
various  discussions  around  the  identified  needs  will  serve  as  the  basis  for  generating 
potential  solutions  to  these  needs.  Once  solutions  are  proposed,  activities  and  action 
steps  can  be  specified.  Finally,  data  collected  for  the  needs  assessment  can  be  used  to 
help  determine  the  Three- Year  Goal  and  the  Yearly  Objectives. 

While  the  Needs  Analysis  phase  technically  ends  once  decisions  are  made  re- 
garding the  needs  to  address  during  the  three  year  cycle,  the  discussions  that  occur  as 
the  plan  is  being  developed  may  lead  staff  to  reconsider  the  conclusions  from  the  needs 
analysis.  Since  the  identified  needs  are  only  meant  to  direct  the  rest  of  the  planning 
process,  generally  there  will  be  no  need  to  revise  the  Needs  Assessment  document  itself 
unless  there  is  to  be  a  major  shift  in  focus.  School  improvement  is  a  cyclical  process, 
one  in  which  the  successful  completion  of  each  phase  results  in  improved  hindsight  and 
hopefully  improved  foresight! 
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Assessing  Needs  -  Forms 


Sample  Forms 


1.  Midyear  Progress  Report  Sample  Page  -  Page  1  of  4: 
System  wide  Indicators  (1  page) 

2.  Midyear  Progress  Report  Sample  Page  -  Page  3  of  4: 
School  Level  Indicators  (1  page) 

3.  MAT6  Total  Reading  Medians  By  Grade  -  Sample  Page 
(1  page) 

4.  MAT6  Individual  Student  Report  Sample  Page  (1  page) 

5.  School  Profiles  Test  Scores  Graphs  Sample  Page  (1 
page) 
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Boston  Public  Schools 

ANNUAL  EDUCATION  PLAN  (1991  -1992) 

SYSTEMWIDE  INDICATORS 

MIDYEAR  PROGRESS  REPORT 


ELEMEMTXRY 

Zone: 

Principal/ 
Headmaster: 

EHROLLKEMT: 

Total 

624 

BlacX 
350 

White 

43 

Asian/PI 

9 

Hispanic 

222 

Nat.  Am. 

SPECIAL  ED: 

Total 

142 

.1 

7 

.2 

26 

.3 

36 

.4 

73 

Other 

BILINGUAL: 

Total 

152 

Mo  SteD 
26 

9tep  2 
96 

Steo  3 

27 

9top  4 
2 

9tep  5 

1 

SYSTEMWIDE    INDICATORS 


Sept-June 
1990-91 


Sept-Dec 
1989 


Sept-Dec 
1990 


Sept-Dec 
1991 


AVERAGE  STUDENT  ATTENDANCE 
grades  KG  -  K2 
grades  1-12 

perfect  attendance 
absent  5  or  fewer  days 
absent  between  6-10  days 
absent  11  or  more  days 

SUSPENSIONS 

events 
pupils 

ANNUAL  DROPOUT 

#  of  students  who  dropped  out 
school  enrollment 

SPED 

students  reviewed 

prototype  increase 

prototype  decrease 

new  referrals 

referred  by  school 

ref.  by  external  agencies 

referred  by  parent 

with  pre-referral  waived 

STAFF  ATTENDANCE 

average  staff  attendance 
perfect  attendance 
absent  5  or  fewer  days 
absent  between  6-10  days 
absent  11  or  more  days 


70.6% 
92.5% 


76.4% 
91.6% 


1 
1 


*  This  number  includes  proposed  and  signed  plans. 


74.0% 
95.4% 


72.9% 
93.1% 


242 

126 

89 

73 

79 

35 

26 

24* 

13 

15 

6 

13* 

45 

25 

17 

18 

29 

13 

11 

8 

16 

12 

6 

10 

19 

9 

9 

91.8% 

96.1% 

91.3% 

94  .  9% 

1 

10 

4 

6 

5 

46 

39 

38 

22 

5 

7 

9 

28 

0 

6 

1 
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Boston  Public  Schools 

ANNUAL  EDUCATION  PLAN  (1991-1992) 

SCHOOL  LEVEL  INDICATORS 

MIDYEAR  PROGRESS  REPORT 


School  Name                Elementary 

Zone 

Principal/ 
Headmaster 

DIRECTIONS:  in  the  last  column,  indicate  the  school's  periormance  to  date  on  each  of  the  objectives  as  reflected  by 
the  measures  of  success. 


School  Objectfve 

Measure  of  Success 

Mid-year  Progress 

for  Suoerintendenfs  Prioiitv  #1: 

1 .  To  provide  an  effective  instructional 
program  in  all  subject  areas  which  will 
show  an  improvement  in  overall 
achievement. 

2.  To  increase  the  MAT  reading  scores 
in  grades  two  through  five. 

3.  To  increase  the  MAT  math  scores  in 
grades  three  through  five. 

1 .  Student  percentiles  on  the 
1992  MAT  reading  and  math  will 
increase  by  3%. 

2.  Students  will  increase  the 
amount  of  literature  books  read 
during  the  year  from  five  to  ten 
and  will  use  more 
problem-solving  strategies  than 
last  year. 

-.- 

ror  Suoerintendent  's  Prioiitv  #2: 

1 .  To  increase  the  activities  of  the 
^'arent  Center. 

2.  To  increase  from  five  to  ten  parents 
A^orking  in  the  Parent  Center  this  year. 

1 .  All  teachers  will 
acknowledge,  through  parent 
surveys,  that  the  number  of 
parents  participating  has 
increased. 

2.  A  post  survey  will  show  that 
50%  of  the  parents  are  more 
knowledgeable  about  their 
child's  academic  program. 

3.  As  compared  to  the 
beginning  of  the  year,  the 
number  of  parent  volunteers  will 
increase  by  five. 

for  SuDsrinWnilsnt  's  Prioritv  #3; 

To  reduce  the  number  of  special  needs 
students  being  substantially  isolated. 

1 .  Teachers  will  find  that  more 
heterogenous  grouping  has  a 
noticeable  positive  effect  on 
85%  of  the  lower  performing 
students,  as  a  result  of  a  student 
assessment. 

2.  Teachers  will  see  by  the  end 
of  the  year  85%  of  SPED 
students  will  show  increased 
academic  progress. 

• 

• 
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TEST-  METROPOLITAN  READING    TOTAL  READING 


09/2<^/91   TtlT3C05 


DATE  OF  A 
TARGET  POPUL 


ON-   MAY   1991 


DATE  OF  ANALYSIS  -   SEPT  1991 


REGULAR  ED»  SPED  «I  AND  ,2 


ZONE 


AND  BILINGUAL  STEPS  h    AND  5 
SCHOOL  h-  —   -^       =LE.HENTARY 


SEPT  1991  RECEIVING  SCHOOL  FORMAT 


GO  RACE 


RECEIVING  MAY  1991  FREgUENCIES 

SCHOOL   BELOW    21-50   31— «^0   '►l-SO   51-60    AbOVE     TOTAL 
"EDIAN  21  PCTL PCTL_  .  PCTL    PCTL    PCTL   60  PCTL   STUCCN" 


02  BLACK 


68 


.2JL 


-12_ 


WHITE 

HISPANIC 

TOTAL 


^1 
66 


TOTAL 


52 


0 
0 

4 


0 
2 
3 


1 
1 

5 


0 
I 

_5_ 


10 


3 
3 
_i2_ 


14       14 
GRAND  TOTAL 


4 

7 

48 


03  BLACK 
WHITE 

36 

* 

9 
0 

1 
0 

5 
0 

4- 
Q 

I 
Q 

6 

2 

26 
2 

HISPANIC 
TOTAL 

* 
39 

1 
10 

1 

2 

1 
6 

1 
5 

1 
2 

1 
9 

6 
34 

Oh    BLACK 
WHITE 
HISPANIC 

38 

* 

8 
0 

1 

8 

2 
0 

7 

2 

2 

11 

8 
0 

1 
9 

h 
0 

Q 

4 

5 
0 

I 
6 

^  hO 

■  4 

..  ^ 

TOTAL 

35 

9 

10 

49 

05  BLACK 

55 
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10 
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T  ,- 
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ASIAN 
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Developing  Goals,  Objectives, 
and  Measures  of  Success 

INTRODUCTION 

Once  a  vision  for  the  school  has  been  identified  through  the  Needs  Assessment 
process.  Goals,  Objectives,  and  Measures  of  Success  need  to  be  developed  in  order  to  fo- 
cus the  school  community  on  specific  targets  to  be  achieved  through  the  Action  Plan. 
Subsequently,  they  will  serve  as  signposts  regarding  the  school's  accomplishments. 
Thus,  the  formulation  of  Goals,  Objectives,  and  Measures  of  Success  has  wide  ranging 
ramificatioris  for  the  school. 

This  section  of  the  Planning  Resource  Guide  presents  various  issues  to  consider 
when  developing  Goals,  Objectives,  and  Measures  of  Success.  Annotated  examples  of 
Objectives  and  Measures  of  Success  are  also  provided. 

WHAT  ARE  GOALS  AND  OBJECTIVES? 

In  most  situations  people  use  the  terms  'Goals'  and  'Objectives'  interchangeably 
to  refer  to  those  things  that  they  want  to  accomplish.  For  purposes  of  plaiming  howev- 
er, there  is  a  distinction  between  these  two  terms  that  is  important  to  keep  in  mind.  In  a 
more  formal  sense  'Goals'  are  general,  often  lofty,  statements  about  some  desirable  out- 
come or  state  of  affairs.  For  example,  worthy  goals  could  be  'to  become  fluent  in  speak- 
ing Sparush'  or,  for  high  school  seniors,  'to  be  well  prepared  for  life  beyond  high  school.' 
These  relatively  general  statements  are  useful  for  communicating  to  the  public  about 
what  the  school  is  trying  to  accomplish  and  for  helping  the  school  community  to  co- 
alesce around  important  issues. 

However,  these  general  statements  have  some  serious  shortcomings  when  it  is 
time  to  develop  the  Action  Plan  and  when  it  is  time  to  determine  if  the  goal  has  been 
achieved.  In  terms  of  guiding  the  development  of  the  action  plan,  goals  are  generally 
too  vague  as  a  means  of  coordinating  the  efforts  of  many  people  toward  a  desired  out- 
come. A  weU  written  objective  may  not  be  inspirational,  but  its  clarity  and  specificity 
can  be  used  as  a  guide  to  action.  For  exan\ple,  an  objective  for  the  fluency  in  Spanish 
goal  could  be  that  after  a  year  of  daily  classes,  students  will  be  able  to  converse  with  a 
native  speaker  of  Spanish  for  five  minutes  about  clothes  with  fewer  than  20  syntax  er- 
rors and  fewer  than  5  semantics  errors.  Given  this  objective,  those  who  are  developing 
the  action  plan  know  that  students  will  have  to  learn  vocabulary  about  clothing  and 
practice  speaking  for  extended  periods  (beyond  providing  short  answers  to  the  teach- 
er's questions). 
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While  it  is  impoi^ant  to  distinguish  between  goals  and  objectives,  it  is  also 
important  to  distinguish  among  types  of  objectives.  Objectives  can  often  be  character- 
ized in  terms  of  what  they  specify:  outcomes,  or  the  means  of  achieving  outcomes.  An  ex- 
ample of  an  outcome  objective  is:  "Attendance  at  parent  meetings  at  the  school  will 
increase  by  20%  over  the  previous  year."  An  example  of  a  possible  means  to  achieving 
that  outcome  is:  "Parent  meetings  will  be  scheduled  in  both  day  time  and  evening  time 
slots."  In  the  Education  Plan,  objectives  should  always  be  stated  in  terms  of  outcomes, 
while  the  Action  Steps  are  the  proposed  ways  to  achieve  the  outcomes. 

HOW  SHOULD  OBJECTIVES  BE  FORMULATED? 

A  well  crafted  objective  should  address  the  question:  "What  is  the  overall  end  re- 
sult we  wish  to  achieve  by  implementing  this  action  plan?"  To  prepare  an  objective 
which  addresses  this  question  it  is  crucial  that  the  objective  refer  to  some  achievement 
or  outcome  rather  than  a  strategy,  process,  action,  or  program.  Saying  that  students 
will  visit  the  Museum  of  Fine  Arts  every  month  is  not  useful  as  an  objective  because  it 
doesn't  indicate  how  the  students  will  be  different  after  these  visits  to  the  musevun.  A 
better  objective  would  be  one  that  combines  the  museum  visits  with  an  outcome,  e.g., 
after  at  least  6  monthly  visits  to  the  Museum  of  Fine  Arts,  students  will  be  able  to  de- 
scribe differences  between  paintings  by  Monet  and  Picasso. 

Another  important  issue  to  keep  in  mind  when  developing  objectives  is  that  they 
have  to  achieve  a  balance  among  being  meaningful,  realistic,  and  verifiable.  Sometimes 
objectives  are  written  in  such  a  way  that  they  are  almost  trivial  and  not  worth  the  effort. 
At  the  other  extreme  are  objectives  which  are  so  ambitious  that  it  would  take  a  cast  of 
thousands  to  implement  them  successfully!  As  with  instruction  for  students,  the  target 
should  be  chaUenging  but  within  the  school's  range  of  capability. 

Finally  there  is  the  issue  of  verifiability.  The  objective  should  be  written  in  such 
a  way  that  it  specifies  a  change  that  can  be  observed  within  the  course  of  the  school 
year.  For  example,  a  school  may  want  to  instill  a  love  of  reading  so  that  students  will  be 
lifelong  readers.  However,  there  is  no  way  to  know  in  one  year  if  students  will  be 
reading  for  pleasure  when  they  are  in  their  20's  or  30's.  An  alternative  objective  which 
would  be  measurable  is:  "By  the  end  of  the  school  year,  at  least  80  of  the  5th  grade  stu- 
dents will  indicate  that  they  are  enjoying  their  non-academic  reading  more  this  year 
than  they  did  last  year." 

Figure  1  on  the  following  page  gives  an  example  of  various  forms  of  an  objective 
related  to  self-esteem.  Issues  related  to  measuring  success  are  discussed  below. 
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Figure  1 

Sample  Objective 


Questionable  Objective: 


OBJECTIVE:  Set  up  a  student  of  the  month'  award  program  to  enhance  students'^  self-esteemi 


\ 


The  focus  is  unclear.  Is  the  outcome  to  be  a  new  rewards 
program  or  some  change  in  students?  An  objective  that 
focuses  on  establishing  a  program  means  that  there  will 
be  no  student  data  by  the  end  of  the  year  to  demonstrate 
progress  toward  fulfilling  the  Superintendent's  priority. 


This  is  a  broad  concept. 
Narrowing  it  would  help 
both  to  measure  the  objec- 
tive and  to  develop  ap- 
propriate activities  and 
action  steps. 


Acceptable  Objective: 


OBJECTIVE:  To  enhance  stiident's|  school  related  self-esteenj  by  the  end  of  the  school  year 


tiid 

1 


This  suggests  the  'who'  and  the  assumption 
is  that  it  would  be  all  students.  This  should 
be  made  more  explicit. 


\ 


This    specifies    'when'    the 
change  would  be  observable. 


This  suggests  that  the  standard  for 
measurement  will  be  a  comparison 
with  some  earlier  status. 


This  specifies  'what'  will  be  different.  This  is 
what  will  be  measured  to  determine  if  the 
objective  is  achieved.  Notice  that  'self- 
esteem'  has  been  narrowed  to  only  cover 
those  aspects  that  relate  to  school. 


Good  Objective: 


ia^MnBaamnMi«ifa6.a;MsaaMaaa 


g-j»rrf!tn-cr.i'<MBigi!g!aan;marnmmi3t!-EBlia 


OBJECTIVE:  To  enhance  school  related  self-esteem  oi  academically  at-risk  4th  and  5^] 
graders  by  the  end  of  the  school  year. 


This  clearly  specifies  the  / 
target  group  of  students. 
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WHAT  IS  A  MEASURE  OF  SUCCESS? 

The  Education  Plan  splits  the  typical  objective  into  two  parts  in  order  to  ensure 
that  the  school  community  specifies  botii  an  area  of  change  and  a  method  whereby  they 
will  know  if  the  change  has  occurred.  The  'Measure  of  Success'  is  the  portion  of  the 
plan  where  the  school  describes  its  procedures  and  criteria  for  monitoring  change. 

A  Measure  of  Success  has  two  parts  described  more  fully  in  sections  below: 

1.  a  performance  indicator 

2.  a  standard 

A  well  written  measure  of  success  is  also  essential  for  determining  and  develop- 
ing consensus  about  how  much  progress  has  been  made  during  the  year.  For  the  Span- 
ish fluency  objective,  teachers  could  assess  students'  speaking  performance  periodically 
during  the  year  to  see  how  many  syntax  and  semantic  errors  they  are  making.  At  the 
end  of  the  year,  it  would  be  relatively  straightforward  to  determine  which  students  had 
achieved  the  objective  and  to  determine  the  progress  that  had  been  made  during  the 
year  by  the  remaiiung  students.  By  specifying  the  target  number  of  acceptable  syntax 
and  semantic  errors,  the  school  has  identified  a  'Measure  of  Success'.  The  difficulty  in 
writing  objectives  is  to  specify  a  measure  of  success  that  is  both  meaningful  in  terms  of 
the  overall  goal,  feasible  in  terms  of  being  achievable,  and  measurable  in  terms  of  the 
indicators  chosen.  The  annotated  examples  presented  below  show  acceptable  and  unac- 
ceptable objectives  and  measures  of  success. 

WHAT  IS  A  PERFORMANCE  INDICATOR? 

The  'performance  indicator'  is  the  target  behavior  that  wUl  be  examined  for  evi- 
dence of  change.  A  performance  indicator  could  be  a  score  on  a  standardized  test,  a 
teacher  rating,  a  child's  self-report,  written  compositions  in  a  writing  folder,  daily  atten- 
dance, etc.  A  'good'  performance  indicator  is  one  that  is  clearly  related  to  the  objective 
and  one  that  is  measurable.  Furthermore,  it  should  be  relatively  easy  and  economical  to 
gather  the  information  regarding  the  status  of  the  indicator.  Some  examples  of  poten- 
tial indicators,  organized  by  Superintendent's  Priority  Areas,  are  listed  in  Figure  2 
below. 
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Figure  2 

Examples  of  Possible  Indicators 

Priority  1:  Improved  Instruction  and  Academic  Achievement 

Student  perfomnance  on  published  tests  (e.g.,  MAT6  median  percentiles) 

Student  performance  on  teacher  made  tests 

Student  performance  on  tests  which  accompany  curriculum  materials  (e.g.,  HBJ  Series) 

Reading  information,  such  as  student  reading  logs 

Averaged  results  from  graded  Writing  Portfolios 

Averaged  results  from  structured  performance  assessments* 

Averaged  results  from  spontaneous  performance  assessments* 

Report  Card  Grades 

Teacher  ratings  on  class  participation 

Teacher  ratings  on  homework  completion 

Informal  written  observations  of  students 

Compiled  anecdotal  records,  observations 

Teacher  checklists** 

Priority  2:  Increased  Parental  and  Community  Participation  in  the  School.  '' 

Attendance  figures  for  parents  at  school-community  events 

Attendance  figures  for  parents  at  school  open  houses. 

Number  of  parer'  volunteers  (e.g.,  library  help,  reading  to  class,  etc.) 

Parent  membership  on  school  committees 

Parent  survey  results,  summarized  comments 

Teacher  checklists** 

Compiled  results  of  interviews  with  parents 

Compiled  results  of  interviews  with  students 

Priority  3:  Identification  and  support  of  students  with  special  needs. 

Attendance,  tardy,  and  truancy  rates 

Suspension  rates 

Retention  rates 

Course  enrollment  information 

Case  reports  by  counselors 

Compiled  student  interviews 

Documentation  of  intervention,  e.g.,  after  school  program,  extra  help,  etc. 

Completion  of  homework  assignments 

Discipline  referrals 

Dropout  rates 

Course  grades 

Changes  in  SPED  prototypes 

Changes  in  Bilingual  LAU  steps 

Niunber  of  students  taking  the  SSAT  to  apply  to  Exam  schools 

Honor  roU/  other  school  based  awards 

*      Performance  assessment  is  defined  as  the  observation  and  rating  of  student  behavior  and  products  in 

contexts  where  students  actually  demonstrate  proficiency  (Stiggins,  1984). 
**     Examples  available  upon  request  from  the  Office  of  Research  and  Development. 
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If  the  sc±iool  is  going  to  develop  its  own  indicator  or  use  one  from  some  other 
school  system,  some  issues  to  consider  are  its  cost,  time  and  training  needed  to  adminis- 
ter and  score  the  instrimient,  and  its  appropriateness  for  the  target  group.  Interpret- 
ability  of  the  results  should  also  be  kept  in  mind  when  choosing  an  indicator. 

WHAT  IS  A  STANDARD?^ 

A  standard  is  the  frame  of  reference  the  school  uses  to  judge  whether  or  not  the 
objective  was  achieved.  In  most  cases  the  Standard  answers  the  question  of  'How 
Much?'  The  Standard  can  be  phrased  in  a  way  that  there  is  a  comparison  with  a  base- 
line. For  example,  one  standard  could  be  that  daily  attendance  will  be  two  percentage 
points  higher  this  year  than  last  year.  The  rate  for  last  year  is  the  reference  point  for  de- 
termining if  this  year's  rate  has  improved  by  two  percentage  points.  Another  common 
reference  point  for  standardized  tests  is  the  national  norm  group.  The  examples  in  Fig- 
ures 3  and  4  show  potential  shortcomings  of  poorly  written  measures  of  success.  As 
with  objectives,  the  Standard  should  be  meaningful  and  worth  striving  to  achieve. 

CONCLUSION 

The  development  of  useful  Goals,  Objectives,  and  Measures  of  Success  requires 
careful  thought  and  dialogue.  The  end  result  of  this  effort  will  be  an  Action  Plan  that 
leads  to  meaningful  action  rather  than  dissatisfied  reaction. 


'      Not  to  be  confused  with  the  Systemwide  Standards. 
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Figure  3 

Sample  Measures  of  Success  -  Improved  Student  Perfomiance 


OBJECTIVE:  To  improve  reading  comprehension  for  all  students  in  grades  4  and  5  by 
May,  1992. 


Questionable  Measure  of  Success: 

1.  MAT6  reading  scores  wdll  increase.  < 


Neither  the  time  frame  nor  the  magnitude 
of  acceptable  change  is  specified. 


r 


The  objective  refers  to  all  students  making  gains.  The  median  is  not  the  correct 
statistic  to  use  since  it  is  very  possible  for  the  median  to  increase  while  many  stu- 
dents' percentile  scores  decrease.  Perhaps  the  objective  should  be  modified. 


^ ^_  ^ ,^     ^ ^_ 

2.  Increase  in  thel median  percentileslor  thdMAT6  Reading  TestlbyQO  points  |rom  May,  1991  to  May, 


1992. 


The  objective  refers  to  comprehension  but  the  measure  includes 
the  score  for  the  entire  MAT6  Reading  test.  Using  just  the  com- 
prehension subtest  scores  might  be  more  appropriate. 


The  size  of  the  improvement  in 
the  median  percentile  appears 
to  be  large.  Is  this  reasonable 
for  the  target  group? 


t>.,-jw.vj«.»sa4^yj>.jtaag/ii»m.<^J^i«..iti..t«a4»A-<i«»ai«i,-^it).j 


g'i.at.jT»!s«ragjii^ij.-.^;«jj^j.j.j'i«i.'.jinj?.'ji3f.v.'.   ^B»-»njB»ja.;ia«M;jjju.g!enm 


Acceptable  Measure  of  Success: 


2.  Students  will  advance  ione  book  |in  the  HBJ  reading  series  over  the  course  of  the  year. 


Is  one  book  an  acceptable  level  of  improvement 
during  the  course  of  the  school  year? 


Good  Measures  of  Success: 


-s^ 


1.  The  May  1992  MAT^Reading  Comprehension  Subtests  percentile  will  be  higher  for  each  student  ihan 
their  May,  1991  percenter -^ ^  * jr ' 


The  comprehension 
subtest  is  specified. 


This  indicates  that  each  student  is  expected  to  im- 
prove compared  to  the  national  norm  group. 


2.  On  average,  studentslwill  advance  1  to  3  books  (depending  on  the  grade)|in  the  HBJ  reading  series 


from  the  beginning  of  th'^yeai^rEKe-smrKJia-sraBiis^aeDTS-arrgwm 


The  amount  of  progress  expected 
is  acknowledged  to  be  different  at 
different  grade  levels. 


The  time  frame 
is  made  explicit. 
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Figure  4 

Sample  Measures  Of  Success  -  School  Related  Self-Esteem 


Questionable  Measure  of  Success: 


i»  \  f  \  f  V 

i  Students!  will  makeiewerhegativelcominentslabout  themselves. 


Which  students, 
'air,  'some',  only 
5th  grade,  etc. 


What  is  an  acceptable  or  desirable  amount  of  de- 
crease? Are  7  negative  comments  in  May  really 
better  than  8  negative  comments  in  October?  How 
should  the  calculation  be  done?  Does  'fewer'  refer 
to  an  overall  average  or  does  it  refer  to  at  least  one 
or  more  fewer  comments  for  every  target  student? 


What  is  the  time  frame 
and  what  is  the  context? 
Does  this  refer  to  com- 
ments made  in  the  cafe- 
teria among  friends, 
comments  to  a  teacher 
after  school,  etc.? 


;■■!.,  i;>;ivaigiit'B;ga8i^-gi;j.-aa>jiA.j 


gsasra  ..i.^^' j!gmj!!5-vi»»-.m-CT'<j»^>-m!n«n 


rm'ft'argi.iv'^'TBgmi! 


.:)y^:«Y^^--'l'.-t'J.."" 


Acceptable  Measure  of  Success: 


I  All  4th  and  5th  gTadelat-risk  students  will  make  fewerpiegative  comments  about  themselves  kt  the  end  of 


TBryirara^TSg^afga'  to  the  beginning  of  the  school  year 


This  specifies  the 
target  group.  But  is  it 
reasonable  to  expect 
success  for  every 
targeted  student? 


/ 


The  time  frame  for 
the  comparison  is 
clear 


To  develop  appropriate  activities  and  mea- 
surement procedures,  greater  specificity  is 
needed  regarding  'negative  comments'. 
Should  the  focus  be  on  negative  comments 
about  physical  ability,  physical  appearance, 
creative  ability,  or  reading  ability,  etc.? 
Should  there  be  the  same  focus  for  each 
child? 


Good  Measure  of  Success: 


This  specifies  a  real  school  setting  in  which 
you  are  expecting  a  change  of  behavior  to 
occur  (and  to  be  observed). 


V "1 

When[given  a  difficult  reading  passage  to  read  aloud  j  (i.e.  a  passage  with  a  reading  diffijajUgiJevel  one 

—  "■"      —  '"' ^---j:^',i — 1^    -Ti  4..1-  -ij^Jg^  grade  at-risk  students  will  make fewerKegative 

itself*!at  the  end  of  the  year  compared  to"tjge"Degirming 


grade  above  their  current  reading  level)   all  4th  ancTSSi  grade  at-risk  students  will  makejewer  jiegative 

ding  ability  or  the  task  its 


comments  about  their  rea 
of  the  school  year. 


The  shaded  part  clarifies  the  'working 
definition'  of  'difficult'  and  thereby  in- 
creases the  likelihood  that  there  will  be 
consistency  not  only  in  'difficulty'  of  the 
task  between  the  start  and  the  end  of 
the  school  year  but  also  across  stu- 
dents and  classrooms. 


This  clarifies  the 
types  of  state- 
ments that  are  of 
primary  concern. 


The  success  criteria  are  still  the 
same:  'all'  target  students  and  no 
specific  number  is  given  regarding 
the  acceptable  reduction  in  the 
number  of  negative  comments. 
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WHAT  IS  AN  ACTION  PLAN? 

In  a  way  an  Action  Plan  tells  one  how  to  get  from  here  to  there,  but  it  isn't  just  a 
road  map.  It  is  more  like  an  airline  flight  guide  which,  once  the  user  has  selected  a  des- 
tination, provides  information  about  various  routes  (flight  times,  number  of  cormec- 
tions  along  the  way,  type  of  aircraft  to  be  used,  meals  to  be  served,  fares).  Some  people 
love  to  study  flight  guides,  but  others  just  want  to  know  how  much  it  will  cost  and 
when  they  will  get  there.  However,  those  who  do  not  like  to  use  the  flight  guide,  still 
know  that  the  pilots,  the  ground  crews,  and  other  airline  personnel  are  all  working  to- 
gether to  fulfill  the  'promises'  implied  on  the  flight  guide.  So  too  with  the  Action  Plan 
that  is  part  of  your  school's  Educational  Plan.  The  plan  can  be  used  in  various  ways  de- 
pending on  the  users'  needs.  However,  the  Action  Plan  needs  to  be  developed  carefully 
so  that  it  can  indeed  serve  as  a  guide  for  the  coming  school  year. 

WHY  IS  AN  ACTION  PLAN  NEEDED? 

The  Action  Plan  is  the  vehicle  for  the  school  to  move  from  ideas  and  intentions  to 
results.  As  such,  both  the  development  and  the  content  of  the  Action  Plan  should  be 
considered  carefully  in  order  to  increase  the  chances  of  success.  Furthermore,  once  the 
staff  begin  to  implement  the  plan,  if  it  is  clear,  well  articulated,  and  supported  by  the 
school  community,  the  document  becomes  a  key  reference  point  for  coordinating  the  ac- 
tivities of  staff  and  for  ensuring  that  the  school's  efforts  are  proceeding  as  intended. 
This  is  not  to  say  that  the  Action  Plan  is  meant  to  be  cast  in  stone.  Indeed  it  is  just  the 
opposite:  the  Action  Plan  is  just  a  plan  and  plans  are  made  to  be  changed.  Yet,  without 
a  well  articulated  plan,  the  inevitable  changes  which  occur  as  the  year  progresses  are 
likely  to  be  chaotic;  the  principal  or  headmaster  may  try  to  make  changes  while  teachers 
make  their  own  adjustments,  often  without  taking  the  rest  of  the  school  into  consider- 
ation. On  the  other  hand,  with  a  well  articulated  plan,  staff,  both  individually  and  as  a 
group,  can  monitor  their  efforts  and  orchestrate  changes  as  needed. 

HOW  IS  AN  ACTION  PLAN  DEVELOPED? 

The  Objectives  that  have  been  formulated  serve  as  the  destination  to  be  reached 
via  the  steps  that  will  be  specified  in  the  Action  Plan.  The  basic  question  is  how  to  get 
from  where  the  school  currently  is  to  where  the  school  community  wants  to  be.  To  an- 
swer this  question  effectively,  a  number  of  other  issues  need  to  be  considered  right  at 
the  start.  For  example,  if  the  school's  goal  is  to  increase  parent  involvement  in  monitor- 
ing and  helping  their  children  with  their  homework,  the  school  staff  need  to  ask  them- 
selves questions  such  as  the  following:  what  they  have  tried  in  the  past  and  why  those 
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approaches  may  not  have  worked  as  well  as  intended;  what  skills  and  resources  they 
can  bring  to  this  problem,  and  what  other  skills  and  resources  may  be  needed;  and  what 
resistance,  if  any,  they  might  encounter  in  trying  to  achieve  this  objective.  Another  key 
preliminary  cor\sideration  is  how  the  action  steps  taken  to  achieve  this  objective  will  af- 
fect other  desired  Objectives  and  other  ongoing  practices  in  the  school.  Is  fine  tuiiing  of 
current  practices  needed  or  are  more  extensive  changes  needed? 

While  there  are  a  series  of  preliminary  questions  to  be  addressed,  it  is  also  impor- 
tant to  consider  how  they  will  be  addressed.  Since  many  people  will  be  involved  in  the 
implementation  of  the  Action  Plan,  its  development  should  be  an  inclusionary  process. 
Thus,  the  group  which  formulates  the  plan  should  include  people  with  relevant  exper- 
tise and  in  some  cases  those  who  will  be  affected  by  the  plan,  as  well  as  those  who  will 
have  responsibility  for  implementing  the  plan. 

Table  1  lists  the  preliminary  questions  that  should  be  addressed.  While  these  are 
some  of  the  first  questions  to  be  addressed,  they  may  have  to  be  revisited  as  the  group 
begins  to  specify  concrete  steps.  ., 

Table  1 

Action  Plans:  Preliminary  Questions 


1.  What  do  we  want  to  achieve?  (See  the  relevant  objectives.) 

2.  What  has  been  tried  up  until  now  in  this  area? 

3.  What  resources  are  needed  to  implement  the  plan? 

a.  financial 

b.  staff 

c.  time 

d.  physical 

4.  Is  there  likely  to  be  resistance  to  changes  in  the  area(s)  covered  by  the  Action 
Plan? 

HOW  ARE  ACTIVITIES  GENERATED? 

The  Action  Plan  is  organized  by  Action  Steps'  which  name  specific  activities. 
These  activities  should  be  well  thought  out  and  specific  enough  to  guide  staff  in  the 
school.  Furthermore,  they  should  be  listed  in  sequence  so  that  teachers,  other  staff,  par- 
ents, and  even  in  some  cases  the  students  themselves  know  what  is  expected  of  them  as 
the  year  progresses.  The  Action  Steps  do  not  need  to  specify  ongoing  or  routine  activi- 
ties unless  the  plan  calls  for  some  change  in  the  activity  itself.  For  example,  it  would 
not  be  necessary  to  mention  that  students  would  be  assigned  regular  homework  as  an 
Action  Step.  However,  if  the  plan  is  to  institute  the  use  of  portfoUos,  and  homework  is 
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to  be  included  in  the  portfolio,  an  Action  Step  should  describe  instances  when  routine 
homework  is  to  be  kept  for  inclusion  in  the  student's  portfolio.  Thus,  the  Action  Steps 
should  specify  things  that  are  expected  to  change  during  the  year. 

Ideas  for  the  Action  Steps  and  Activities  can  come  from  many  different  sources. 
Obviously,  the  members  of  the  planning  group  are  likely  to  have  ideas  that  can  be  writ- 
ten into  the  plan.  Other  members  of  the  school  community  including  parents  should  be 
canvassed  for  ideas.  Beyond  the  school,  staff  from  the  central  office,  community  and 
business  partners,  staff  from  other  BPS  schools,  educational  journals  and  other  profes- 
sional publications  can  be  consulted  for  ideas.'  The  questions  listed  in  Table  2  can  be 
asked  as  each  Action  Step  is  written. 

Table  2 

Action  Plans:  Appropriateness  of  Activities 

1.  Is  the  activity  doable? 

If  the  action  step  is  not  feasible,  it  will  lead  to  frustration  among  staff. 

2.  Is  the  activity  necessary  to  achieve  the  objective? 

Unnecessary  steps  may  cause  dissatisfaction,  skepticism  and  gnmibling  among 
staff  as  weU  as  wasting  precious  time  and  resources. 

3.  Is  it  likely  that  the  activity  will  "work"  as  intended? 
Ineffectual  action  steps  may  demoralize  the  staff. 

If  the  answer  is  'no'  to  any  of  these  questions,  the  step  probably  does  not  belong 
in  the  plan.  If  the  answers  are  'maybe',  the  team  developing  the  Action  Steps  should 
ask  themselves  if  there  are  alternative  action  steps  that  are  more  likely  to  lead  to  the  de- 
sired results.  It  may  not  be  possible  to  answer  these  questions  with  certainty  -  this  is 
one  reason  why  this  is  a  'plan'  rather  than  a  'cookbook'.  Nevertheless,  team  members 
should  be  able  to  give  tentative  reasons  why  the  step  is  feasible,  necessary,  important, 
and  reasonably  likely  to  work. 

Table  3  lists  other  issues  that  should  be  considered  when  formulating  Action 
Steps.  Resources,  timelines,  and  staffing  should  be  considered  carefuUy  as  the  plan  is 
being  formulated.  A  good  idea  is  important,  but  good  ideas  are  not  enough  to  ensure 
that  the  plan  will  be  successful.  Adequate  resources  and  support  are  crucial  for  the  suc- 
cess of  the  plan. 


'       The  Office  of  Research  and  Development  has  a  list  of  initiatives  that  schools  proposed  for  the  first 
year  of  their  Three  Year  Education  Plan. 
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Table  3 

Action  Plans:  Key  Issues  to  Consider 


Is  the  time  allocated  for  each  Action  Step  sufficient? 

Are  any  Action  Steps  due  to  start  before  other  prerequisite  steps  have 
been  completed? 

Is  there  any  way  to  hasten  one  or  more  Action  Steps  so  that  students  or 
parents  receive  the  most  benefit  from  the  new  initiative? 

Are  there  other  events  that  are  likely  to  be  occiirring  at  the  same  time 
which  may  interfere  or  take  away  from  the  impact  of  any  Action  Step? 

Is  there  sufficient  flexibility  in  the  timeline  to  allow  for  inevitable  delays? 

Is  there  going  to  be  sufficient  time  during  the  year  or  at  the  end  of  the  year 
to  observe  the  impact  of  the  Action  Steps? 


Is  there  an  adequate  training  component  (if  one  is  required)? 

Do  the  Action  Steps  include  a  proviso  for  additional  training  or  support 
for  those  participants  who  may  be  having  difficulty  mastering  or  imple- 
menting the  new  activity? 

Do  the  Action  Steps  specify  time  when  staff  can  get  together  to  reflect  on 
how  the  new  irutiative  is  progressing? 

Do  the  Action  Steps  clearly  indicate  those  activities  which  will  require 
staff  to  be  out  of  the  classroom  or  to  stay  after  school  for  trairung  or 
meetings? 

Do  the  Action  Steps  include  awareness  activities  for  staff  who  are  not  di- 
rectly involved  in  the  new  initiative? 


Resources  and  Supports  Needed 

1.  If  funding  is  needed,  is  the  source  and  amount  of  money  specified? 

2.  Is  the  amount  of  fimding  going  to  be  adequate  to  successfully  complete 
the  Action  Steps 

3.  If  consultants  are  needed,  are  their  areas  of  required  expertise  clearly  spe- 
cified or  understood? 

4.  If  consultants  are  needed,  are  they  likely  to  be  available  when  needed? 

5.  Are  the  space  and  materials  needed  clearly  specified?  Will  they  be  suffi- 
cient to  complete  the  Action  Steps? 


Timelines 
1. 
2. 

3. 

4. 

5. 
6. 

Staffing 
1. 
2. 

3. 
4. 
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6.  Is  it  clear  who  is  responsible  for  ensuring  that  the  resources  for  each  Ac- 
tion Step  are  made  available  when  needed?  (These  are  not  necessarily  the 
same  people  who  are  responsible  for  carrying  out  the  Action  Steps.) 

7.  If  the  allocated  resources  prove  to  be  inadequate,  are  there  contingency 
plans  for  securing  other  resources? 

8.  Are  there  any  steps  that  require  approval  beyond  the  school  itself,  e.g.,  the 
Office  of  Bilingual  Education?  If  yes,  is  it  likely  that  approval  will  be 
given? 

9.  Is  there  another  way  that  specific  Action  Steps  can  be  completed  with  a 
better  utilization  of  resources? 

People  Responsible 

1.  What  skills  are  needed  to  successfully  carry  out  the  Action  Steps? 

2.  Do  the  people  have  the  skills  needed  to  implement  the  Action  Steps 

3.  If  the  target  people  are  not  very  interested  in  taking  on  resporisibility  for 
the  Action  Steps,  is  there  a  way  to  make  the  tasks  more  desirable  or  less 
burdensome,  e.g.  sharing  responsibility  with  other  staff? 

4.  Do  the  people  assigned  to  the  Action  Steps  have  the  authority  or  good 
will  of  the  staff  or  parents  to  successfully  implement  them? 

5.  To  miriimize  the  burdens  on  school  staff,  have  human  and  other  resources 
in  the  community  been  identified? 

HOW  SHOULD  STAFF  DEVELOP  CONSENSUS  REGARDING  THE  FLAN? 

As  the  plan  is  being  formulated,  and  definitely  once  a  draft  is  completed,  the 
planning  group  should  be  working  to  develop  and  maintain  support  for  the  plan  from 
the  broader  school  community.  If  representatives  from  key  groups  within  the  school 
community  are  included  in  the  planning  group,  it  is  likely  that  the  final  plan  will  be 
agreeable  to  those  who  have  to  implement  it  and  those  who  will  be  affected  by  it.  The 
planning  group  can  also  take  a  proactive  role  in  keeping  others  informed  about  their 
work  by  posting  minutes  of  meetings,  holding  informal  meetings,  and  passing  around 
preliminary  drafts  for  review  and  comment. 

Table  4  lists  some  issues  that  may  make  it  easier  or  harder  to  develop  a  consen- 
sus for  the  plan  among  members  of  the  school  community. 
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Table  4 

Action  Plan:  Issues  that  May  Affect  Consensus 

1.  As  the  level  of  difficvilty  in  implementing  the  plan  increases,  resistance  among 
staff  will  tend  to  increase.  To  minimize  resistance,  if  a  difficult  approach  is  cho- 
sen, the  likelihood  of  the  approach's  succeeding  should  be  relatively  high. 

2.  As  the  cost  of  the  plan  increases,  resistance  among  those  affected  by  the  likely  de- 
crease in  available  funds  will  tend  to  increase.  To  minimize  resistance,  if  an  ex- 
pensive approach  is  chosen,  the  likelihood  of  the  approach's  succeeding  should 
be  relatively  high. 

3.  If  the  needs  and  proposed  solutions  do  not  fit  within  the  values  of  the  school 
community,  resistance  to  the  plan  is  likely  to  be  great. 

4.  Everything  else  being  equal,  selecting  an  'exciting'  approach  may  be  better  in 
terms  of  promoting  positive  engagement  in  the  Action  Steps. 

CONCLUSION 

While  the  development  of  the  Action  Plan  takes  considerable  thought  and  craft- 
ing, the  result  is  a  document  that  is  meant  to  guide  the  efforts  of  hundreds  of  adults  and 
students  during  the  coming  years.  A  well  crafted  plan  will  be  well  worth  the  planning 
team's  effort. 

A  sample  Action  Plan  is  presented  on  the  following  page. 
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All  the  assessing  and  planning  in  the  world  amount  to  very  little  unless  action  is 
taken  and  the  plan  is  implemented.  During  this  stage,  school  improvement  moves  from 
discussion  and  planning  to  action.  Implementation  is  (or  should  be)  the  longest  phase 
of  the  Assess-Plan-Implement-Monitor  cycle. 

The  best  way  to  start  implementation  is  with  a  well-developed  plan.  As  noted  in 
the  previous  section,  a  plan  that  specifies  the  'who',  'what',  'when',  and  'how'  of  each  ob- 
jective and  embeds  the  objectives  in  a  rational  sequence  has  a  better  chance  of  being  im- 
plemented successfully  than  one  which  is  vague.  A  clear  plan  will  also  be  much  easier 
to  monitor  in  an  ongoing  way.  Midcourse  corrections,  which  will  most  likely  be  need- 
ed, will  be  easier  to  determine  and  apply. 

KEY  ISSUES  IN  IMPLEMENTATION 

What  follows  is  a  series  of  questions  which  should  be  addressed  in  the  course  of 
implementing  the  plan.  Most  if  not  aU  of  these  issues  should  be  attended  to  throughout 
the  implementation  phase. 

1.  Have  there  been  any  changes  which  affect  the  school's  capacity  to  carry  out  the 
plan? 

Plans  may  have  been  developed  some  time  before  implementation  begios,  and 
conditions  on  which  the  plan  was  based  can  change.  Examples  include:  transfers 
or  layoffs  of  key  persormel,  budget  cuts,  external  funds  being  reduced  or  in- 
creased, etc.  If  adverse  changes  have  occurred,  the  plan  may  need  to  be  modi- 
fied. Even  a  positive  change,  such  as  the  availability  of  new  resources,  may 
require  a  modification  of  the  plan.  Of  course,  changes  could  also  occur  at  any 
time  after  the  implementation  phase  begins. 

2.  Does  everybody  understand  the  plan  and  his  or  her  part  in  it? 

It  can  easily  occur  in  any  work  group  that  there  are  numerous  different  under- 
standings of  both  the  task  and  individuals'  roles  in  the  task.  Undetected,  these 
discrepancies  can  create  major  conhision  and  misunderstandings.  If  misunder- 
standings can  be  corrected  in  a  supportive,  non-blaming  way,  they  are  not  a  ma- 
jor barrier  to  accomplishing  the  plan. 

3.  Does  everybody  have  a  sense  of  "ownership"  of  the  plan,  and  a  willingness  to 
take  individual  as  well  as  group  responsibility  for  the  plan's  success? 

Even  the  most  positive  change  is  in  some  measure  stressful;  even  the  best  of 
ideas  will  meet  with  resistance,  overt  or  covert.      Effective  approaches  to 
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implementation  occur  when  planners  are  aware  of  these  facts  and  account  for 
them.  If  the  planning  process  has  gone  relatively  well,  people  who  are  expected 
to  carry  out  the  plan  will  feel  a  commitment  to  it. 

If  it  seems  clear  that  some  participants  are  not  "behind"  the  plan,  then  it  is  worth 
taking  some  time  to  try  to  change  the  situation.  For  instance,  if  there  are  new 
staff  who  did  not  participate  in  developing  the  plan,  some  way  to  encourage 
them  and  bring  them  on  board  should  be  found. 

What  will  be  the  mechanism  for  coordinating  the  plan  and  for  overseeing  and 
morutoring  its  implementation? 

There  is  no  one  prescribed  approach  here.  In  SBM/SDM  schools,  the  School  Site 
Council  might  be  the  appropriate  one  to  coordinate  and  monitor  the  plan.  In 
other  schools,  it  might  be  a  committee  composed  of  those  who  were  most  active- 
ly involved  in  developing  the  plan.  Whatever  group  is  involved,  it  should  repre- 
sent the  various  stakeholders  in  the  school  (e.g.,  teachers,  administrators, 
parents,  business  partners)  to  the  degree  possible. 

The  timetables  in  a  good  plan  will  help  keep  the  process  on  track.  See  the  chap- 
ter "Monitoring  the  Education  Plan  -  Assessment  and  Evaluation"  for  details  on 
the  process  of  monitoring  implementation. 

What  provisions  are  there  for  ongoing  communication  about  the  process? 

Good  communication  is  crucial  to  the  success  of  the  plan,  and  multiple  methods 
should  be  used.  Regular  formal  meetings  of  the  group  with  primary  responsibil- 
ity are,  of  course,  one  way  to  ensure  commimication.  Time  could  be  carved  out 
of  the  early  release  days  and  after  school  sessions  to  focus  no  elements  of  imple- 
mentation. However,  since  not  everybody  can  attend  meetings,  less  formal  ways 
of  "touching  base"  should  be  developed.  A  project  bulletin  board,  a  newsletter, 
periodic  letters  sent  to  parents,  etc.  would  also  be  useful. 

Another  component  of  communication  is  providing  opportunities  for  those  car- 
rying out  various  parts  of  the  plan  to  talk  with  each  otiier.  For  instance,  if  im- 
proving reading  is  a  major  thrust  of  the  plan,  then  reading  teachers  should  have 
some  time  to  coordinate  and  communicate  with  each  other  about  their  efforts.  In 
other  contexts,  those  who  are  carrying  out  different  yet  related  aspects  of  the 
plan  could  be  given  occasional  opportunities  to  touch  base  with  each  other. 

What  support  mechanisms  are  there  for  those  who  are  carrying  out  the  plan? 

This  question  is  related  to  communication,  but  goes  beyond  it.  Trying  anything 
new  can  be  difficult,  and  there  may  be  all  sorts  of  unanticipated  problems.  It  can 
help  to  have  "someone  to  talk  to"  for  support.  This  person  may  be  someone  from 
the  school  (staff  might  be  paired  into  "buddies",  for  instance)  or  perhaps  a  re- 
source person  in  the  level  office.  The  point  here  is  that  the  need  for  both  profes- 
sional and  personal  support  for  those  engaging  in  the  change  process  should  be 
acknowledged  and  provided  for  in  some  appropriate  way. 
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7.  What  provisions  are  there  for  ensuring  parental  support  for  and  involvement  in 
implementing  the  plan? 

Clearly,  regular  and  systematic  communication  with  parents  about  the  plan  is 
important,  but  information  is  not  enough.  Parents  who  have  the  time  may  be  a 
resource  for  a  wide  variety  of  activities,  but  creativity  in  finding  ways  to  involve 
parents  will  be  needed. 

8.  Is  maximum  use  of  the  resources  at  the  level  and  central  offices  being  made? 

It  may  take  some  research  to  identify  the  most  appropriate  resource  person(s)  for 
a  given  issue,  but  the  effort  will  be  rewarded. 

9.  What  is  being  done  to  create  a  school  climate  that  is  conducive  to  change? 

Here,  the  role  of  the  principal  or  headmaster  is  particularly  important.  Charac- 
teristics of  administrators  who  are  helpful  for  adoption  of  a  plan  include:  clear 
understanding  of  and  support  for  the  plan;  respect  for  the  role  of  each  person 
who  shares  responsibility  for  carrying  out  the  plan;  good  supervisory  skills;  will- 
ingness to  support  and  encourage  risk-taking,  with  a  tolerance  for  the  imperfec- 
tions which  are  inevitable  in  trying  anything  new;  and  a  capacity  to  foster 
constructive  relationships  among  staff  and  others  involved. 

The  bviildtng  administrator  is  not  the  only  one  who  can  help  support  a  climate 
for  change,  however.  Among  all  staff,  being  slow  to  criticize  and  fast  in  offering 
help  and  support  to  one's  colleagues  can  help. 

Students  can  be  brought  into  the  plan  in  ways  appropriate  to  their  age  group.  As 
all  teachers  know,  students  can  generate  a  lot  of  enthusiasm  and  ideas  if  they  feel 
that  what  they  do  matters.  If  an  objective  is  for  4th  graders'  math  skills  to  be  in- 
creased, students  should  know  about  it.  Displays,  stickers,  T-shirts,  and  all  the 
other  incentives  that  make  sense  for  a  given  group  of  students  can  be  used. 
There  could  be  a  banner  proclaiming  a  few  of  the  most  important  objectives  of 
the  plan  in  the  front  hall  of  the  school. 

CONCLUSION 

Implementation  is  the  'action'  phase  of  the  plarming  cycle.  It  is  the  chance  for  ev- 
eryone to  bring  the  plan  to  fruition.  While  there  are  likely  to  be  'ups  and  dov^^r\s,'  and 
some  things  which  do  not  work  as  anticipated,  implementation  can  be  a  gratifying  and 
exciting  time  in  the  life  of  a  school. 
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Monitoring  the  Education  Plan: 
Assessment  and  Evaluation 


OVERVIEW 

Carefully  monitoring  what  is  carried  out  as  a  result  of  your  action  plan  and  ex- 
amining the  effects  of  these  actions  are  crucial  parts  of  the  educational  planning  process. 
All  too  often,  what  happens  with  educational  innovations  is  that  a  new  initiative  is  pro- 
posed, implemented,  and  becomes  common  practice,  without  its  ever  being  carefully  re- 
viewed to  determine  if  the  new  practice  is  any  better  than  the  old  one. 

The  Three- Year  Education  Plan  will  be  monitored  each  year  in  three  different 
ways: 

1 .  Midyear  Review; 

2.  Year-End  Review; 

3.  Ongoing  monitoring. 

The  Midyear  Review  serves  as  a  means  of  formative  evaluation  to  see  if  the  plan  is 
on  track  at  midyear  allowing  for  adjustment  and  fine  tuning  to  ensure  success  by  the 
end  of  the  academic  year.  The  Year-End  Review  serves  as  a  summative  evaluation  at  the 
close  of  the  academic  year  to  determine  if  the  objectives  for  the  current  year's  action 
plan  were  successfully  met.  Ongoing  monitoring  can  be  of  two  types:  formal  and  infor- 
mal. Informally,  teachers,  administrators,  and  parents  should  take  stock  of  how  things 
are  going,  and  regularly  discuss  details  and  improvements  with  each  other.  Executors 
of  the  Education  Plan  should  also  formulate  means  to  gather  information  on  a  regular 
basis  to  assess  the  plan's  progress.  Details  of  each  of  these  assessment  types  are  pre- 
sented below. 


If  vou  need  to  know  more  about ... 


Midyear  Review  A&E-    1 

Year-End  Review    A&E-    9 

Ongoing  Monitonng    A&E-  21 

MIDYEAR  PROGRESS  REVIEW 

As  part  of  the  Education  Plan  process,  progress  on  the  current  year's  Action  Plan 
will  be  assessed  at  midyear.  This  provides  schools  with  the  opportunity  to  reflect  on 
progress  made  to  date,  to  determine  whether  or  not  the  plan  is  moving  ahead  as  sched- 
uled, to  assess  if  the  plan  has  begun  to  produce  the  anticipated  changes,  and,  based  on 
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this  midyear  reflection,  to  fine  tune  the  overall  plan.  The  Midyear  Review  essentially 
consists  of  completing  the  Midyear  Progress  Report.  A  sample  of  the  report  is  provided 
along  with  a  description  of  each  of  its  sections. 

MIDYEAR  PROGRESS  REPORT  FORMAT 

A  sample  four  page  Midyear  Progress  Report  form  is  included  in  Appendix  C: 
FORMS.  A  form  with  the  systemwide  data  printed  on  it  will  be  sent  to  the  school  at 
midyear  (typically  in  Mid-January).  This  form  is  provided  to  assist  in  the  review  of  pro- 
gress. Each  page  is  described  below: 

Page  1:  Systemwide  Indicators  -  Data 

A  sample  of  page  1  is  presented  below.  The  information  on  this  page  is  prepared 
by  the  Office  of  Information  Systems  and  sent  to  the  schools.  Information  includes 
overall  demographic  data  for  your  school  as  well  as  performance  on  those  systemwide 
indicators  that  are  appropriate  for  midyear  review.  Four  periods  of  data  are  included. 
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The  first  column  provides  figures  for  the  previous  entire  school  year.  The  next  three  col- 
umns provide  figiires  for  September  through  December  for  the  current  year  and  for 
September  through  December  for  the  two  prior  school  years.  This  information  should 
be  useful  in  looking  at  trends  in  your  school  over  time.  Each  indicator  is  explained  in 
detail  below  in  Table  1  on  page  A&E  -  5. 

Page  2:  Systemwide  Indicators  -  Comments 

This  page  is  for  comments  on  the  progress  made  to  date  for  each  indicator.  The 
page  is  completed  by  the  school  and  provides  a  unique  opportuiuty  for  each  school  to 
respond  to  factors  which  influenced  performance  on  the  particular  indicator.  Based  on 
a  review  of  the  information  provided  on  page  1  of  the  Report  as  well  as  data  gathered 
during  the  first  half  of  the  year  within  the  school,  comments  should  address  specific  ac- 
tion steps  taken  regarding  each  indicator  and  the  effectiveness  of  the  specific  actions  to 
maintain  or  improve  performance  on  the  indicator. 
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Page  3:  School  Level  Indicators 

Page  3  of  the  Report  (exhibited  below)  provides  an  opportunity  to  address  di- 
rectly each  of  the  objectives  of  the  Education  Plan  and  reflect  on  the  progress  made  by 
midyear.  The  first  two  columns  should  be  completed  by  the  school  based  on  the  Educa- 
tion Plan  for  that  year.  (If  changes  need  to  made  in  the  objectives  or  measures  of  suc- 
cess, they  should  not  be  made  here  but  on  Page  4  of  the  Report  described  below.)  In  the 
third  column.  Midyear  Progress,  progress  should  be  described  with  respect  to  the 
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measures  of  success.  If  data  from  the  measure  that  you  intend  to  use  are  not  available 
at  midyear,  progress  should  be  described  based  on  data,  information,  and  observations 
as  available.  If  it  involves  data  that  the  school  is  collecting,  indicate  the  specific  proce- 
dures used  to  collect  the  data. 

Page  4:  Mid-Year  Amendment  Form  (Optional) 

This  optional  page  of  the  Report  may  be  used  if  any  element  of  your  school's 
Education  Plan  needs  to  be  amended  (See  Appendix  C:  FORMS  for  a  sample)  .  This 
would  be  the  case  if,  for  example,  a  deadline  was  not  met  or  a  measure  of  success  was 
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found  to  be  unrealistic  and  required  modification.  A  timeline  for  the  Mid-Year  Review 
Process  is  provided  in  the  yearly  Superintendent's  Circular  "Educational  Planning  Proc- 
ess." (For  1994-95  the  circular  was  #5.) 

Table  1  presents  a  detailed  explanation  of  each  systemwide  indicator  used  for  the 
Midyear  Review  Process. 


Table  1 

Systemwide  Indicators  used  on  the  Midyear  Progress  Report 
Explanation  of  Indicators 

The  following  table  explains  the  systemwide  indicators  used  on  the  Midyear  Pro- 
gress Report  and  the  cautions  to  be  observed  when  interpreting  the  data. 


Indicator 


Definition 


irposefM'Usii^. 
^Indicator 


Cautions  to  Be  ;^ 
Noted  When  Using 
li^icator 


Average  Student  Attendance 

Grades  KO  -  K2  &    A  percentage  calculated  as  the  av- 
Grades  1  - 12  erage  daily  attendance  divided  by 

the  average  daily  membership 
based  on  the  data  provided  to  Re- 
cords Management  Unit.  Septem- 
ber data  are  not  used  because  of 
the  temporary  large  number  of 
DNR's    Although  the  title  of  the  row 
("grades  1-12")  applies  to  all 
grades,  the  percentage  is  com- 
puted only  from  the  actual  grades  in 
the  school.  Elementary  schools 
have  the  Kindergarten  percentages 
separated  from  the  other  grades. 


(Midyear  data  are  calculated  as  of  the  last 
school  day  in  December.) 


Compare  average 
student  attendance 
for  the  current  year 
with  data  from  a  simi- 
lar period  for  the  pre- 
vious two  years 


Note  that  for  this  and 
all  other  indicators, 
the  first  column 
spans  the  total  previ- 
ous year,  while  the 
next  three  columns 
are  for  the  first  half 
year  only  for  the  past 
three  years.  These 
data  group  all  the 
grades  (e.g.,  1-5  for 
elementary)  together, 
possibly  masking  a 
problem  occurring  only 
within  one  grade  (e.g., 
1st  grade). 
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Indicator 


Definition 


Purp<»Blbrlh»^^ 
'}-*'  Indlcatiwr  ^ 


Cauiiofislb  Belli 
Noted  Wheii  Ushig^ 
'brfjcatoT'-"' 


Perfect  The  number  of  students  who  were 

Attendance  present  every  school  day  within  the 

time  frame    For  students  coming  in 
the  middle  of  the  term,  attendance 
begins  when  the  student  is  admit- 
ted. (Histoncal  note:  Prior  to  1992 
attendance  numbers  were  available 
only  for  those  schools  which  used 
the  on-line  Automated  Attendance 
System.) 

Absent  1-5  The  number  of  students  absent  the 

Absent  6-10  days    specified  days  within  the  time 

frame. 
Absent  11 -plus 

days 


Breakdown  of  the  av-  (Historical  note:  Reli- 
erage  attendance  into  able  data  for  years 


subgroups  to  allow 
for  a  closer  analysis 
of  a  possible  prob- 
lem.   For  example,  a 
school  with  a  lower 
attendance  rate  can 
see  if  the  problem 
lies  with  students 
chronically  absent 
(i.e.,  >11  days)  or 
with  some  other 
group. 


prior  to  1 992  are  not 
available.) 


Suspensions 

Events 


Pupils 


The  number  of  suspension  events 
recorded  during  the  time  frame. 
Students  may  be  counted  more 
than  once    Data  reflect  suspension 
activity  at  the  school  dunng  the  year 
even  if  a  student  transfers  to  an- 
other school  before  the  end  of  the 
year.  For  example,  a  student  at 
School  A  might  have  2  suspension 
events  and  transfer  to  School  B 
where  he  then  had  1  suspension 
event    School  A  would  show  2 
events  and  1  student.  School  B 
would  show  1  event  and  1  student. 


Schools  can  examine 
how  their  suspension 
rate  for  this  half  year 
compares  with  prior 
similar  periods  and 
with  the  previous  year 
overall.  Considerably 
more  events  than  pu- 
pils indicates  that  a 
few  students  are  be- 
ing suspended 
repeatedly. 


The  number  of  students  suspended 
dunng  the  time  frame    See  defini- 
tion for  Events  above  for  explana- 
tion of  how  schools  are  credited 


The  number  of  sus- 
pensions by  mid  year 
could  fluctuate  from 
year  to  year  while  the 
overall  yearly  suspen- 
sion rate  remains  con- 
stant. That  is,  one 
year  the  majority  of 
suspensions  could  oc- 
cur during  the  first  half 
of  the  year   The  next 
year  the  majority  of 
suspensions  could  oc- 
cur dunng  the  second 
half  of  the  year,  but 
overall  there  could  be 
the  same  number  of 
suspensions  for  both 
years    This  caution 
applies  to  the  other  in- 
dicators as  well.  Be- 
cause elementary 
school  suspension 
numbers  are  so  small, 
changes  from  year  to 
year  should  be  inter- 
preted with  caution. 
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Indicator 


Defnutmn     l— '^fjr 


^^  PliiTOseiDrllstiig 
ilndicaior^^ 


^  Cautjonsio  Bt^^ 
Noted  When  Ush«^ 

lndicafir^-^j:t 


Annual  Dropout 

#  of  students  who 
dropped  out 


This  indicator  applies 
primarily  to  high 
schools.  This  indica- 
tor provides  one  per- 
spective on  the 
school's  holding 
power. 


Number  of  students  who  dropped 
out  during  the  time  frame.  Stu- 
dents are  considered  dropouts  if 
they  were  in  grades  6-12  when  they 
withdrew  and  were  assigned  any  of 
the  following  discharge  categories: 
over  16,  marriage,  pregnancy  or 
parenting;  entenng  the  military; 
employment;  pursuing  a  GED  or 
other  non-diploma  educational  pro- 
gram; illness;  registered  but  did  not 
report,  or  moved  with  no  forward- 
ing address. 

Special  Education     (These  data  reflect  all  Special  Education  administrative  activity  at  the  school 
during  the  time  frame,  irrespective  of  where  students  were  enrolled  at  the  end  of  the  year.) 


Note  that  these  num- 
bers reflect  the  stu- 
dents who  dropped 
out  within  the  time 
frame  only.  As  a  re- 
sult, midyear  figures 
are  less  meaningful 
than  end-of-year 
figures. 


students  reviewed   The  number  of  students  whose 

plans  were  reviewed  for  placement 
regardless  of  whether  a  transfer  in 
or  out  of  the  program  actually  oc- 
curred.   Regular  Education  stu- 
dents reviewed  for  entry  into  SPED 
are  included. 

prototype  increase  The  number  of  students  whose  pro- 
totype increased  dunng  the  time 
frame  within  the  school    This  in- 
cludes students  moving  from  Regu- 
lar Education  into  SPED 


This  figure  provides 
an  overview  of  SPED 
activity  and  thus 
serves  as  a  basis  for 
analyzing  more  spe- 
cific SPED  activities. 

Prototype  increases 
and  decreases  can 
be  monitored  with  ref- 
erence to  similar  time 
periods  across  sev- 
eral years. 


prototype 
decrease 


The  number  of  students  whose  pro- 
totype decreased  dunng  the  time 
frame  within  the  school    This  in- 
cludes students  mainstreamed  out 
of  SPED  altogether 


The  numbers  for  pro- 
totype increase  or  de- 
crease for  the  current 
Sept-Dec.  period  re- 
flect proposed  proto- 
type changes 
irrespective  of  whether 
or  not  the  plan  has 
been  signed.  Note 
that  there  are  certain 
categories  of  special 
needs  that  are  less 
likely  to  change  than 
others. 
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Indicator' 


new  referrals 


Defini&on 


Punxne^lM^ 
[ndic^lml 


_    iUlioiisloBe^ 


referred  by  school 

referred  by  exter- 
nal agencies 

refen-ed  by  parent 

with  pre-referra! 
not  waived 


The  total  number  of  new  referrals  to 
SPED  occurring  within  the  school 
during  the  time  frame  regardless  of 
whether  the  referral  resulted  in  a 
meeting  or  was  later  withdrawn. 
Counts  include 'T'  students  (stu- 
dents residing  in  Boston  but  attend 
BPS  only  part  time  for  special 
services). 

A  breakdown  of  the  number  of  new 
referrals  initiated  dunng  the  time 
frame  by  the  referring  agency.  The 
three  numbers  sum  to  the  total 
number  of  new  referrals. 

The  number  of  new  referrals  initi- 
ated dunng  the  time  frame  where 
the  pre-referral  process  was  not 
waived. 


This  variable  is  bro- 
ken down  into  sub- 
categories. Thus  a 
school  can  see  from 
where  the  bulk  of 
new  referrals  is 
coming. 


Mid  year  data  are  not 
as  meaningful  as  end- 
of-year  data  and 
should  be  used  only 
for  planning  purposes. 
Includes  'T'  students 
which  are  enrolled  in 
private/parochial 
schools  receiving  par- 
tial services  from  BPS 
school. 


The  school  can  moni- 
tor the  percent  of  new 
referrals  with  pre- 
referral  not  waived. 


Staff 
Attendance 


Average  Staff 
Attendance 


Perfect 
Attendance 


Absent  1-5 

Absent  6-10  days 

Absent  11 -plus 
days 


(Staff  include  administrators,  teachers,  and  profsssibnal  support  staff  such  as  li- 
brarians, guidance  counselors,  nurses,  and  ETL's.  Other  support  staff  are  not 
included.  Days  absent  include  only  sick  days.  Attendance  at  approved  educa- 
tional conferences  is  not  considered  an  absence.  Approved  leaves  and  personal 
days  are  excluded .) 

Compare  average 
staff  attendance  for 
this  half  year  with 
data  from  a  similar 
penod  for  the  previ- 
ous two  years. 


This  IS  the  total  number  of  staff 
days  present  divided  by  the  total 
number  of  staff  days  possible. 


The  numt)er  of  staff  who  were  pre- 
sent every  school  day  during  the 
time  frame  beginning  when  the  staff 
person  started  at  that  school. 


The  numt)er  of  staff  who  were  at>- 
sent  the  specified  days  within  the 
time  frame. 


Breakdown  of  the  av- 
erage attendance  into 
subgroups  to  allow  a 
closer  analysis  of  a 
possible  problem 
For  example,  a 
school  with  a  lower 
attendance  rate  can 
see  if  the  problem 
lies  with  staff  chroni- 
cally absent  (i.e.,  >11 
days)  or  with  some 
other  group. 


Note  that  the  numbers 
in  the  last  three  col- 
umns (half  year  data) 
tend  to  be  greater  than 
the  first  column  (full 
year  data)  for  the  first 
two  rows  (absent  0-5 
days)  due  to  the 
longer  time  frame  In 
which  to  be  absent 
represented  in  the  first 
column. 
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YEAR-END  REVIEW 

School  improvement  is  a  cyclical  process.  Perhaps  the  most  important  activity  in 
the  education  planning  process  is  the  year-end  taking  stock  of  what  has  been  accom- 
plished and  what  aspects  of  the  Plan  need  to  be  addressed  and  further  refined.  To  as- 
sist in  conducting  a  thorough  Year-End  Review,  schools  are  required  to  complete  an 
End-of-Year  Report  which  provides  for  a  structured  year-end  summative  evaluation  of 
the  Plan  to  assist  the  principal,  the  Zone  Superintendent,  and  the  school  community  in 
assessing  the  Plan's  successes  and  shortcomings. 

This  section  describes  the  End-of-Year  Report  process,  reviews  the  forms  to  be 
completed  by  the  school  as  part  of  the  process,  and  provides  the  1993-94  timeline  of 
relevant  dates.  A  full  size  sample  End-of-Year  Report  form  can  be  found  in 
Appendix  C:  Forms. 

END  OF  YEAR  REPORT 

The  final  step  of  the  Education  Plan  yearly  cycle,  the  End-of-Year  Report,  serves 
as  an  opportunity  for  your  school  to: 

1.  gather  and  examine  the  Measures  of  Success  and  reflect  upon  the 
progress  made  over  the  course  of  the  year; 

2.  determine  whether  or  not  the  plan  was  implemented  as  intended; 

3.  assess  if  the  plan  accomplished  what  was  expected; 

4.  review  the  three  year  trend  for  the  systemwide  indicators  and  consider  if 
the  Plan  adequately  addressed  the  school  performance  goals; 

5.  inform  the  school  community  as  to  planning  needs  for  the  upcoming 
academic  year  and  refine  the  Three- Year  Plan  based  on  end-of-year  data. 

END  OF  YEAR  REPORT  AND  THREE  YEAR  PLAN 

A  critical  factor  in  assessing  the  success  of  your  school's  Education  Plan  is  the 
availability  of  end-of-year  data  for  the  academic  year  just  completed.  Because  a  num- 
ber of  key  variables  such  as  test  scores,  promotion  rates,  attendance  rates,  etc.,  are  not 
available  until  the  "books  are  closed"  at  the  end  of  the  school  year,  both  the  end  of  year 
assessment  and  the  planning  for  the  upcoming  year  cycle  cannot  be  fully  accomplished 
until  the  beginning  of  the  next  school  year.  For  this  reason,  the  Education  Planning 
process  involves  the  development  of  a  draft  Action  Plan  for  June  prior  to  the  year  in 
planning  and  an  opportunity  to  fine  tune  the  Plan  in  September  of  the  year  in  planning. 
Consequently,  the  Education  Plan  draft  is  developed  and  submitted  in  June  and  can  be 
reevaluated  in  September  on  the  basis  of  more  complete  school  information  about 
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student  performance  as  well  as  more  ciorrent  information  about  staffing  for  the  school 

year. 

Everyone  who  participates  in  the  development  of  the  current  Education  Plan  as 
indicated  on  the  signed  cover  sheet  in  Jime  should  be  given  the  opportimity  to  review 
the  End-of-Year  Report  received  the  following  September  and  sign  the  End-of-Year  Re- 
port signature  page.  The  principal  or  headmaster  should  make  copies  of  the  report  and 
distribute  them. 

END  OF  YEAR  REPORT  AND  SYSTEMWIDE  STANDARDS 

Systemwide  standards  for  each  indicator  have  been  adopted  by  the  School  Com- 
mittee and  have  been  distributed  to  your  school  by  means  of  a  Superintendent's  Circu- 
lar. A  copy  of  the  standards  can  be  found  in  this  Resource  Guide  in  the  chapter 
Systemwide  Indicators  and  Standards. 

END  OF  YEAR  REPORT  FORMAT 

Each  page  of  the  End-of-Year  form  is  described  below. 

Cover  Page  (sample  form  shozvn  on  page  A&E-ll) 

This  page  includes  a  box  with  the  appropriate  year's  school  demographic  data 
(e.g.,  1992-1993  for  the  just  finished  1992-93  school  year)  including  enrollments  by  race, 
program.  At  the  bottom  of  the  box  is  an  index  called  the  mobility  index.  The  mobility  in- 
dex gives  the  percent  of  students  who  were  not  enrolled  in  your  school  throughout  the 
entire  school  year.  Specifically,  the  mobility  index  includes  those  students  who  have 
moved  into  your  school  at  some  point  during  the  school  year  after  October  1  through 
the  last  day  of  school.  This  index  is  important  because  it  is  a  measure  of  the  rate  of  mo- 
bility in  a  given  school.  Note  this  index  was  modified  at  the  beginning  of  SY93-94. 

Signature  Page 

Everyone  who  participated  in  the  development  of  the  current  Education  Plan  as 
indicated  on  the  signed  cover  sheet  in  June  should  be  given  the  opportunity  to  review 
the  End-of-Year  Report  received  the  following  September  and  sign  the  End-of-Year  Re- 
port signature  page. 

Page  1  of  4:  Education  Plan  Priorities  #3  -  #3 

This  page  lists  the  school's  Objective(s)  and  Measures  Of  Success  for  Superin- 
tendent Priorities  #1  -  #3  which  address  school  level  indicators.  The  first  two  columns 
have  been  completed  by  the  Office  of  Planning,  Research,  and  Development  and  reflect 
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End-of-Year  Report  Cover  Page 


Boston  Public  Schools 


THREE-YEAR  EDUCATION 

PLAN 

END-OF-YEAR  REPORT 

school  year  1992-93 


School  Name 

Principal /Headmaster 

Total  Enrollment               Black            White 

Asian/PI 

Hisp 

Ntv.  Am. 

— 

Special  Education      Total               .1 

2                 3 

.4 

Bilingual  Ediacation:  Total            No  Step 

.  Step  1          Step  2. 

Step 

3         Step  4 



Mobility  Index  (students  not  attending  flus  school  the  entire  year) 

N= 

_%' 

The  cover  page  pro- 
vides programmatic 
enrollment  information 
and  a  mobility  index 
which  gives  the  per- 
centage of  students 
who  were  not  enrolled 
in  the  school  for  the 
entire  school  year. 


your  school's  stated  objectives  and  measures  as  they  appeared  on  the  Three- Year  Edu- 
cation Plan  form  submitted  to  the  Zone  Superintendent  in  the  fall  of  1992  (or  modified 
formally  since  then).  The  principal  or  headmaster  shall  have  responsibility  for  com- 
pleting the  third  column  labeled  End-of-Year  Status  by  addressing  each  of  the  meas- 
ures of  success  and  by  providing  the  appropriate  evidence  indicating  the  outcome  of 
the  objective  and  to  what  degree  each  objective  was  met.  This  information  should  sum- 
marize all  data  gathered  at  the  school  as  specified  by  the  measures  of  success.  The  link 
between  the  measure  of  success  and  its  outcome  status  should  be  clear  and 
unambiguous. 

Pages  2  and  3:  Education  Plan  Priorities  #4  -  Systetnwide  Indicators 

All  the  data  on  pages  2  and  3  are  prepared  by  the  Office  of  Technology  and  In- 
formation Services.  The  information  is  gathered  from  many  sources  including  atten- 
dance files,  testing  files  and  others.  The  information  on  page  2  focuses  on  performance 
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End-of-Year  Report  Page  1 


School: 


Boston  Pubuc  Schools 

THREE- YEAR  EDUCATION  PLAN 

END-OF-YEAR  REPORT 

(1992-1993) 


DIRECTIONS:  In  the  last  column,  indicate  the  schoors  en(Krt.year  pertomance  on  each  ol  the  obiectves  as  redacted  by  « 
measures  of  success  "-  =«  k/y  ^ 


ScboatOtieeam 


(Improved  student  perfonnance) 


Superintendent  s  Pnonty  #2: 
(Increased  parental  and 
community  participation) 


Supenntendenl  's  Pnonty  #3: 
(Identification  and  of  support  of 
students  with  unique  needs) 


Page  1  of  4 


This  page  addresses 
school  level  indicators. 
The  school  completes 
this  page,  listing  the 
school's  Objective(s), 
Measures  of  success, 
and  corresponding 
status  of  each  Meas- 
ure for  Superintendent 
Priorities  #1  -  #3.  Su- 
perintendent Priority 
#4  is  addressed  on 
pages  2-4. 


on  key  systemwide  indicators,  while  information  for  supporting  indicators  appears  on 
page  3.  Data  are  provided  for  three  school  years  including  the  year  in  review  and  the 
two  previous  years  (e.g.,  the  End-of-Year  Report  for  Year  One  of  the  Three-Year  Educa- 
tion Plan  [1992-93]  includes  data  from  1990-91,  1991-92,  1992-93).  This  information 
should  be  useful  m  looking  at  trends  in  your  school  over  time  and  placing  this  year's 
achievements  into  a  larger  perspective. 

Explanation  of  the  Standards  Columns 

Two  new  columns  were  added  to  the  form  at  the  beginning  of  SY93-94    The  col- 
umn labeled  'Standard  for  School'  presents  the  standard  to  be  met  by  your  school 
Standards  may  be  a  fixed  number  such  as  the  average  daily  attendance  fixed  at  95%  for 
the  Elementary  level;  or  they  may  be  a  relative  number  representing  an  improvement  in 
the  school  relahve  to  some  prior  performance  level  such  as  the  number  of  suspensions 
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(the  standard  is  a  reduction  by  50%  from  the  SY1991-92  level).  Table  2  below  presents 
those  indicators  whose  standard  is  a  fixed  percentage. 


Table  2 

Systemwide  Indicator  Standards  that  are  Fixed 


Indicator 


Standard 


Average  daily  attendance 


95%  -  Elementary 
92%  -  Middle 
90%  -  High 


Percent  promoted 


98%  -  Elementary 
95%  -  Middle 
90%  -  High 


Percent     eligible     taking      MAT6      (Reading      and  98%  -  Elementary 
Mathematics)  95%  -  Middle 

95%  -  High 


Staff  Attendance 


98%  -  Elementary 
98%  -  Middle 
98%  -  High 


SPED  -  Prototype  Increases 


10% 


SPED  -  Prototype  Decreases 


50% 


Bilingual  Program  Step  Increases 


35%  -  Elementary 
50%  -  Middle 
50%  -  High 


Table  3  below  presents  those  indicators  whose  standard  must  be  calculated 
separately  for  each  school,  being  based  on  some  level  of  prior  performance.  Because 
relative  standards  are  school  specific,  the  actual  number  associated  with  a  particular 
relative  standard  will  differ  from  school  to  school.  The  calculations  necessary  to  com- 
pute the  school-specific  standard  have  been  performed  for  your  convenience  and  the 
results  are  provided  in  this  column. 
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Table  3 

Systemwide  Indicator  Standards  that  are  Relative 


Indicator 


Standard 


Number  of  Suspensions  and 
Number  of  Pupils  Suspended 


Reduction  by  50%  from  SY91-92  level. 
(The  number  of  suspensions  or  pupils  sus- 
pended for  1 992-93  is  compared  against  .50 
times  the  number  for  SY91-92.) 


Percentage  of  dropouts 


Middle  level  -  Reduction  of  1  percentage 
point.  (The  percentage  of  dropouts  for 
SY92-93  should  be  at  least  1  less  than  the 
percentage  of  dropouts  for  SY91-92.) 

High  school  level  -  Reduction  of  3  percent- 
age points.  (The  percentage  of  dropouts  for 
SY92-93  should  be  at  least  3  less  than  the 
percentage  of  dropouts  for  SY91-92.) 


Students  scoring  below  the  40th  percentile  on  the 
MAT6 


Reduction  by  10%  for  reading  and  mathe- 
matics. (The  percentage  for  SY91-92  is  re- 
duced by  10  percentage  points  to  determine 
the  standard.) 


Students  scoring  above  the  60th  percentile  on  the 
MAT6 


Increase  by  5%  for  reading  and  mathemat- 
ics. (The  percentage  for  SY91-92  is  in- 
creased by  5  points  to  determine  the 
standard.) 


SPED  -  New  Referrals 


Reduction  of  50%  or  more  from  SY91-92. 
(The  number  of  new  referrals  for  SY92-93  is 
compared  against  .50  times  the  number  for 
SY91-92.) 


•  Number  of  first  choices  by  regular  education  parents 


Increase  over  previous  year.  (The  number 
of  first  choices  for  1992-93  is  compared 
against  1  +  the  number  for  SY91  -92.) 


Note  that  dark  shaded  areas  block  out  the  standards  columns  for  those  system- 
wide  indicators  on  Page  2  not  associated  with  a  standard.  Finally,  the  column  labeled 
'Status  Against  Standard'  presents  an  asterisk  '*'  if  the  standard  has  been  met  or  a  mi- 
nus sign  '-'  if  the  standard  has  not  yet  been  met.  Page  3  does  not  have  the  two  stan- 
dards columns  because  standards  are  not  associated  with  this  group  of  indicators. 
Elementary  schools  will  notice  that  Attendance  data  on  Page  3  is  blank  because  this  in- 
formation is  only  provided  for  schools  which  use  the  on-line  Automated  Attendance 
System. 


BPS  R&D 


A&E  - 14 


9/1993 


Monitoring  the  Education  Plan  -  Year-End  Review 


Page  4  of  4:  Comments  on  Systemwide  Indicators 

This  page  must  be  completed  by  the  principal  or  headmaster.  This  page  is  used 
for  comments  on  the  end  of  year  status  reported  for  each  indicator.  Care  should  be 
taken  to  address  those  indicators  for  which  standards  have  not  yet  been  met.  Based  on 
a  review  of  the  information  provided  on  pages  2  and  3  of  the  Report  as  well  as  data 
gathered  during  the  year  within  the  school,  comments  should  address  specific  action 
steps  taken  regarding  each  indicator  and  the  effectiveness  of  the  specific  actions  to 
maintain  or  improve  performance  on  the  indicator.  It  is  a  unique  aspect  of  the  process 
in  that  it  allows  you  to  provide  any  additional  evidence  or  explanations  that  may  not 
appear  on  pages  1-3.  It  provides  you  an  opportxmity  to  address  the  more  qualitative  as- 
pects of  measuring  performance.  For  example,  in  reviewing  the  data  for  your  school, 
you  might  notice  that  the  student  attendance  had  noticeably  decreased.  As  an  explana- 
tion, you  might  note  that  your  school  had  a  high  percentage  of  special  education  stu- 
dents who  were  adversely  affected  by  a  bus  strike  in  the  fall.  You  could  indicate  that  in 
order  to  provide  additional  support  to  these  children,  special  homework  and  additional 
tutorial  help  were  provided.  Also,  positive  results  obtained  on  selected  indicators 
should  be  commented  on. 


END-OF-YEAR  REPORT  AND  SCHOOL  INTERVENTION 

Assistant  Superintendents  shall  review  each  school's  status  in  the  implementa- 
tion of  its  School-Based  Performance  Objectives  and  performance  relative  to  the  system- 
wide  indicators  and  shall  make  a  determination  concerning  the  required  level  of 
intervention,  if  objectives  are  not  being  met.  Further  information  on  intervention  can 
be  fovmd  in  this  Resource  Guide  in  the  chapter  Intervention. 

Table  4  provides  an  explanation  of  the  systemwide  indicators  appearing  on  the 
End-of-Year  Report  form.  The  explanation  of  the  systemwide  indicators  provides  for 
each  indicator  a  definition,  the  purpose  for  using  the  indicator,  and  cautions  to  be  ob- 
served when  interpreting  the  data. 

Table  4 

Systemwide  Indicators  used  on  the  End-of-Year  Report 
Explanation  of  Indicators 


ImlicatxH-                         DefinHioft 

Purpose  fn*  Usn^   Cautions  io  Be  Noted 
Indicator                When  Usb% 
indicator 

Average  Student  Attendance 

(All  data  are  calculated  as  of  tlie  last  school 
day.) 

Attendance:                  A  percentage  calculated  as  the  av-    Compare  average  stu-  These  data  group  all 
Grades  KO  -  K2;        erage  daily  attendance  divided  by      dent  attendance  for  the  grades  (e.g.,  1-5 
Grades  1-12           the  average  daily  membership           the  year  under  reviews  for  elementary)  to- 
based  on  the  data  provided   by           with  data  from  the  pre-  gether,  possibly 

vious  two  years. 
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bHilcator 

Definl&Hi 

Purpose  for  UsB^   CantKms  to  Be  Noted 
indicator                When  Usii^ 
indicator 

Perfect 
Attendance 


Absent  5  or  Fewer 
Days; 

Absent  6-10  Days; 

Absent  1 1  or  More 
Days 

Suspensions 

Occurrences 


Pupils 


Promotion 

Promotion  Rate 


eacti  school  to  the  Reconj  Manage- 
ment Unit.  Although  the  title  of  the 
row  (Grades  1-12)  applies  to  all 
grades,  the  percentage  is  computed 
only  from  the  actual  grades  in  the 
school.  Elementary  schools  have 
the  Kindergarten  percentages  sepa- 
rated from  the  other  grades. 

The  number  of  students  who  were 
present  every  school  day  during  the 
school  year.  For  students  coming 
in  the  middle  of  the  term,  atten- 
dance begins  when  the  student  is 
admitted.  These  data  are  available 
only  for  schools  which  use  the  on- 
line Automated  Attendance 
System. 

The  number  of  students  who  are  ab- 
sent the  specified  number  of  days 
within  the  school  year.    These  data 
are  available  only  for  schools  which 
use  the  on-line  Automated  Attendance 
System. 


The  number  of  suspension  occur- 
rences recorded  during  the  school 
year.  Students  may  be  counted 
more  than  once.  Data  reflect  sus- 
pension activity  at  the  school  during 
the  year  even  if  a  student  transfers 
to  another  school  before  the  end  of 
the  year.  For  example,  a  student 
was  suspended  twice  at  School  A 
and  once  from  School  B.  School 
A  would  show  2  occurrences  and  1 
student,  and  School  B  would  show 
1  occurrence  and  1  student. 

The  number  of  students  suspended 
during  the  school  year.  See  defini- 
tion for  Occurrences  above  for  ex- 
planation of  how  schools  are 
credited. 


The  number  and  percent  of  stu- 
dents who  were  promoted  to  the 
next  grade  as  of  June. 


masking  a  problem  oc- 
curring only  within  one 
grade  (e.g.,  1st  grade). 


Breakdown  of  the  av- 
erage attendance  into 
subgroups  to  allow  for 
a  closer  analysis  of  a 
possible  problem.    For 
example,  a  school  with 
a  lower  attendance 
rate  can  see  if  the 
problem  lies  with  stu- 
dents chronically  ab- 
sent (i.e.,  >11  days) 
or  with  some  other 
group. 


Schools  can  examine 
how  their  suspension 
rate  for  the  year  just 
past  compares  with 
prior  years.  Consid- 
erably more  occur- 
rences than  pupils 
indicates  that  a  few 
students  are  being 
suspended 
repeatedly. 


For  elementary 
schools,  since  suspen- 
sion numbers  are  so 
small,  changes  from 
year  to  year  should  be 
interpreted  with 
caution. 


Schools  can  examine  Note  that  figures  do 
how  their  promotion     not  include  those  stu- 
rate  for  the  year  just    dents  who  were  pro- 
past  compares  with      moted  during  the 
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Indicator 


Definition 


Purpose  fm- Using   Cautions  fo  Be  Noted 
Indicator  . ,  When  Using 

,.  ^ —      ^  indicator       .^ 


Annual  Dropout 

Dropout  Rate 


Number  of  students  who  dropped 
out  during  the  year  from  July  1  to 
June  30th.  Students  are  considered 
dropouts  if  they  were  in  grades  6-12 
when  they  withdrew  and  were  as- 
signed any  of  the  following  dis- 
charge categories:  over  16; 
marriage,  pregnancy  or  parenting; 
entering  the  military;  employment; 
pursuing  a  GED  or  other  non- 
diploma  educational  program;  ill- 
ness; registered  but  did  not  report; 
or  moved  with  no  forwarding  ad- 
dress. The  percentage  is  based  on 
the  total  number  of  students  en- 
rolled at  any  time  during  the  year  for 
that  school.  However,  students  en- 
rolled in  more  than  one  school  over 
the  year  are  counted  only  in  the  last 
school  attended.  Students  who 
transferred  out  of  the  system  are 
not  included  in  the  calculations.  In 
accordance  with  state  guidelines, 
summer  dropouts  are  counted  at 
the  school  to  which  they  were  as- 
signed for  the  fall.  (Historical  Note: 
for  years  prior  to  1990-91 ,  the  pro- 
cedures differed  somewhat  be- 
cause age  was  taken  into  account.) 


This  indicator  which 
applies  primarily  to 
high  schools,  pro- 
vides one  perspec- 
tive on  the  school's 
holding  power. 


Dropout  rates  in  middle 
schools  are  generally 
very  low,  and  therefore 
a  change  for  only  a  few 
students  from  one  year 
to  the  next  could  have 
an  impact  on  the  drop- 
out percentage. 

(Historical  Note:  begin- 
ning in  1991-92,  the 
State  required  report- 
ing of  ail  students  in 
grades  6  to  12  who 
dropped  out,  irrespec- 
tive of  age.  In  prior     " 
years,  only  students 
who  were  over  age  16 
were  counted  as 
dropouts.) 


MAT6 

MAT6  Median 
Percentiles  by 
grade 


Percent  Eligible 
Population  taking 
the  MAT6  tests 


The  median  percentile  is  the  middle 
score  of  the  distribution  of  scores 
among  eligible  students  in  a  particular 
grade  who  took  the  test. 


The  median  percentile 
at  each  grade  level 
should  be  compared 
with  the  50th  percentile 
which  is  the  national 
average  to  determine 
relative  performance. 


The  eligible  population  is  regular 
education,  SPED  .1  and  .2,  and 
BILED  students  in  Steps  3  and  4. 
The  percent  is  calculated  by  dividing 
the  number  of  eligible  students  for 
whom  answer  documents  are  re- 
turned by  the  total  number  of  eligi- 
ble students  in  the  school. 


This  is  not  the  only 
measure  of  a  school's 
performance  and  should 
be  reviewed  in  light  of  all 
the  other  indicators. 


This  indicator  should  be 
used  in  conjunction  with 
the  median  percentiles. 
A  low  percentage  eligible 
suggests  that  the  median 
percentiles  are  not  an  ac- 
curate reflection  of  the 
school's  performance. 
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Indicator 


Students  scoring: 
Below  the  40th 
percentile; 

From  40th  to  60th 
percentile; 

Above  60th 
percentile 


Definition 


Purpose  for  Using 
Indicator 


Cautions  to  Be  Noted 

When  Using 

Indicator 


This  group  of  indicators  provides  gen- 
eral information  about  the  number  and 
percentage  of  students  scoring  at  the 
low,  average,  and  high  range  for  the 
school  as  a  whole  relative  to  national 
norms.  The  percentage  is  based  on 
the  number  of  eligible  students. 


This  group  of  indicators 
provides  general  infor- 
mation about  the  distri- 
bution of  test  scores 
within  the  school  as  a 
whole. 


Note  that  these  intervals 
are  slightly  different  from 
the  ones  used  in  the  Me- 
dian X  Grade  School  Re- 
ports sent  to  schools  in 
June. 


Special  Education 

Prototype  The  number  of  students  whose  pro- 

Increase  totype  increased  during  the  school 

year  within  the  school.  This  in- 
cludes students  moving  from  Regu- 
lar Education  into  SPED.  School 
designated  as  'meeting  school'  is 
credited  with  increase. 


Prototype 
Decrease 


New  Referrals 


Referred  by 
School; 

Referred  by  Exter- 
nal Agencies; 

Referred  by 
Parent 


Prototype  increases 
and  decreases  can 
be  monitored  with 
reference  to  the  past 
two  school  years. 


The  number  of  students  whose  pro- 
totype decreased  during  the  school 
year  within  the  school.  This  in- 
cludes students  mainstreamed  out 
of  SPED  altogether.  School  desig- 
nated as  'meeting  school'  is  credited 
with  decrease. 

The  total  number  of  new  referrals  to 
SPED  occurnng  within  the  school 
during  the  school  year  regardless  of 
whether  the  referral  resulted  in  a 
meeting  or  was  later  withdrawn. 

A  breakdown  of  the  number  of  new 
referrals  initiated  during  the  school 
year  by  the  source  of  the  referral. 
Percent  is  in  reference  to  the  total 
number  of  referrals  by  source. 


New  referrals  are 
broken  down  into 
subcategories  which 
are  presented  as 
supplemental  indica- 
tors. Thus  a  school 
can  see  from  where 
the  bulk  of  new  refer- 
rals IS  coming. 


Note  that  there  are 
certain  categories  of 
special  needs  that  are 
less  likely  to  change 
than  others.  When  in- 
terpreting changes  in 
prototypes,  an  irv 
crease  means  that  a 
student  spends  less 
time  in  a  regular  edu- 
cation setting  and  a 
decease  in  prototype 
means  that  the  student 
spends  more  time  in  a 
regular  education 
setting. 

Referrals  for  1989-90 
and  1990-91  may  not 
always  be  attributed  to 
the  correct  school 
since  the  'referral 
school'  was  not  a  re- 
quired entry  in  SEIMS 
until  the  1991-92 
school  year.  Prior  to 
1991-92,  the  referral  is 
attributed  to  the  last  at- 
tended school. 


With  Pre-Referral 
not  Waived 


The  number  of  new  referrals  initi- 
ated during  the  school  year  where 
the  pre-referral  process  was  not 
waived. 


The  school  can  moni- 
tor to  what  degree 
the  pre-referral  proc- 
ess is  waived  or  not 
waived. 
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if^icafaH' 


Bilingual  Education 

students  with 
Step  Increases 


DefinitHHi 


PuiposeforUsHM; 
Indicator 


In  program  3  years 
or  less; 

In  program  more 
than  3  years 


Staff 
Attendance 


Average  Staff 
Attendance 


0  Sick  Days 


1-5  Sick  Days; 

6-10  Sick  Days; 

1 1  or  More  Sick 
Days 


time. 


A  Step  increase  is  defined  as  a  Schools  should  exam- 

change  to  Step  2,  3,  or  4.   Students  ine  to  what  degree  the 
moving  out  of  the  Bilingual  Educa-    Bilingual  Education  stu- 
tion  program  (i.e.  from  Step  4  out)     ^®"*=  ^'^  advancing  in 
are  not  included.  Step  changes  are  ^^^  ^*^P  '^^^'^  °^^' 
determined  by  comparing  Step  as- 
signments at  the  end  of  one  year 
with  the  Step  assignment  at  the  end 
of  the  previous  year.    The  percent- 
age is  based  on  the  number  of  stu- 
dents with  Step  increases  divided 
by  the  total  Bilingual  Education  pro- 
gram enrollment. 


Cautimis  io  Be  Noted 

WhenUang 

indicator 


Number  and  percent- 
ages are  based  on  the 
Step  increases  that  are 
entered  in  the  central 
database  at  the  close 
of  the  school  year. 
When  interpreting 
changes  in  Step,  an  in- 
crease means  that  a 
student  spends  more 
time  in  a  regular  edu- 
cation setting. 


This  group  of  supplemental  Indicators 
divides  the  total  number  of  bilingual 
education  students  into  two  groups, 
i.e.,  3  school  years  or  less  and  more 
than  three  school  years,  based  on  the 
total  time  enrolled  in  the  Bilingual  pro- 
gram beginning  with  Kindergarten. 


Schools  should  review 
the  information  regard- 
ing the  years  enrolled 
in  the  bilingual  program 
as  supplemental 
indicators. 


(Staff  include  administrators,  teachers,  and  professional  support  staff.  Other 
support  staff  are  not  included.  Days  absent  include  only  sick  days.  Attendance 
at  approved  educational  conferences  is  not  considered  an  absence.  Approved 
leaves  and  personal  days  are  excluded  .} 

This  is  the  total  number  of  staff         Compare  average 
days  present  divided  by  the  total        staff  attendance  for 
number  of  staff  days  possible.  this  year  with  data 

from  the  previous 

years. 


The  number  of  staff  who  were  pre- 
sent every  school  day  during  the 
school  year  beginning  when  the 
staff  person  started  at  that  school. 


This  group  of  supporting  indicators 
specifies  the  number  and  percent- 
age of  staff  who  were  absent  the 
specified  days  during  the  school 
year. 


Breakdown  of  aver- 
age attendance  into 
sutjgroups  to  allow  a 
closer  analysis  of  a 
possible  problem. 
For  example,  a 
school  with  a  lower 
rate  can  see  if  the 
problem  is  with  staff 
chronically  absent 
(i.e.,  >11  days)  or 
with  another  group. 
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Imiicator 


Delinitkm 


Purpose  ^U!^% 
Indicator 


CsitkmsioBe  Noted 
imiicator 


School  Choice 

Number  of  Students  This  is  the  number  of  regular  edu- 


Requesting 
School  as  First 
Choice 


cation  students  in  grade  1 ,  6,  or  9 
who  requested  the  school  as  the 
top  choice  in  the  first  round.  In  the 
case  of  1st  grade,  parents  whose 
child  had  a  guaranteed  seat  and 
therefore  did  not  mal<e  a  choice  are 
not  included. 


This  indicator  should 
be  reviewed  in  con- 
junction with  the  indi- 
cator of  regular 
education  students 
administratively  as- 
signed to  the  school. 


Regular  Education     This  is  the  number  of  regular  edu- 
Students  Adminis-  cation  students  by  racial/ethnic 
tratively  Assigned   group  who  were  administratively 
After  Round  #1        assigned  to  the  school  as  of  the 
end  of  Round  #1  for  the  entering 
school  grade,  i.e.  1st,  6th,  or  9th 
grade. 


Examining  this  indi- 
cator over  time  can 
provide  information 
about  changes  in  a 
school's  'appeal' 
among  students  of 
various  racial/ethnic 
groups. 


This  is  a  measure  of  a 
school's  overall  'ap- 
peal' and  should  be  in- 
terpreted cautiously  to 
avoid  distortion. 
School  choice  during 
Round  #1  may  be 
viewed  as  a  school's 
'appeal'  during  the 
year  that  the  choice 
was  made.  Thus, 
school  choices  for  the 
1993-94  school  year 
reflects  'appeal'  as  of 
Winter  1992-93. 
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ONGOING  MONITORING 

Ongoing  monitoring  is  the  responsibility  of  each  school  and  is  necessary  in  order 
for  the  planning  team  to  know  if  their  work  is  on  track.  Ultimately  it  is  the  responsibil- 
ity of  the  building  administrator  to  see  that  the  monitoring  is  carried  out,  but  he  or  she 
may  wish  to  designate  another  individual  or  a  small  subcommittee  of  the  team  to  over- 
see the  process. 

WHY  MONITOR? 

"Monitoring"  has  an  unpleasant  sound  to  it,  evoking  an  image  of  a  supervisor 
hovering  over  a  subordinate  as  he  or  she  works.  However,  in  the  context  of  educa- 
tional planning  it  is  important  to  understand  monitoring  in  a  very  different  sense.  The 
purpose  of  ongoing  monitoring  is  not  to  evaluate,  but  to  provide  feedback  and 
problem-solving  in  support  of  the  planning  process. 

There  are  clear  benefits  to  developing  a  systematic  approach  to  ongoing 
monitoring.  For  one  thing,  the  process  of  producing  the  mid-year  and  end-of-year  re- 
ports will  be  greatly  facilitated.  More  importantly,  the  school  will  have  a  clearer  and 
more  current  picture  of  what  is  happening  at  the  school  than  it  has  ever  had  before. 

This  information  can  be  used  in  various  ways.  First,  if  things  are  going  as 
planned,  this  information  can  be  announced  as  a  "pat  on  the  back"  for  staff  and  stu- 
dents. If  monitoring  reveals  problems,  the  information  can  be  used  as  a  starting  point 
for  discussion  with  staff  and  for  the  possible  development  of  mid-course  corrections. 

WHAT  SHOULD  BE  MONITORED? 

During  the  school  year,  everyone  involved  is  likely  to  be  monitoring  the  pro- 
gress of  the  Education  Plan  informally  through  discussions  and  observation.  The  pur- 
pose of  this  section  is  to  provide  suggestions  for  how  to  monitor  the  plan's  progress  in  a 
more  systematic  way.  Suggested  areas  of  concern  about  the  plan's  implementation  in- 
clude the  following: 

a.  Timetable:  Is  the  process  proceeding  on  time? 

b.  Completeness:  Are  all  parts  of  the  plan  being  addressed? 

c.  Satisfaction:  Are  participants  satisfied  with  the  results  so  far? 

d.  Impact:  What  has  changed?  Is  the  school's  status  improving  on  any  of  the 
Systemwide  Indicators? 

e.  Side  Effects:  Have  any  unanticipated  negative  or  positive  consequences 
occurred? 
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Early  on,  the  team  should  conduct  a  meeting  in  order  to  decide  how  to  do  ongo- 
ing monitoring.  Topics  should  include:  1)  what  issues  to  focus  on;  2)  who  will  do  the 
work;  3)  what  specific  data  will  be  collected;  and  4)  how  the  data  will  be  reported. 

One  component  of  ongoing  monitoring  should  be  frequent  commuiucation  both 
among  team  members  and  between  team  members  and  the  larger  school  community. 
For  example,  there  might  be  bi-weekly  "action"  meetings  in  which  staff  report  on  the 
status  of  their  activities  to  the  group  and  receive  feedback  and  suggestior\s.  The  team 
might  want  to  have  a  newsletter,  or,  if  that  is  not  feasible,  at  least  a  bulletin  board  in 
which  various  pieces  of  progress  are  noted.  For  instance,  if  one  part  of  the  plan  in- 
volves using  a  new  approach  in  reading  instruction,  a  brief  description  of  the  new  ap- 
proach could  be  put  on  the  bulletin  board  along  with  a  list  of  classrooms  in  which  it  is 
implemented.  If  improving  writing  skills  is  an  objective  in  the  plan,  exemplary  student 
papers  could  be  posted. 

The  choice  of  issues  on  which  to  concentrate  should  be  related  to  the  areas  of 
greatest  emphasis  in  the  Education  Plan.  If  a  school  has  chosen  to  focus  on  increasing 
student  attendance,  for  instance,  then  student  attendance  should  be  closely  watched. 

In  some  instances,  the  school  may  need  to  take  a  more  detailed  look  at  a  problem 
in  order  to  best  target  their  efforts  at  improvement.  Perhaps  attendance  is  not  a  prob- 
lem among  the  younger  grades  but  is  a  serious  problem  among  the  older  grades.  Or  a 
school  may  discover  that  attendance  problems  are  more  severe  among  the  boys  than 
among  the  girls.  Equipped  with  these  more  precise  understandings,  the  plarming  team 
should  be  able  to  focus  its  efforts  where  they  will  do  the  most  good. 

MONITORING  IMPLEMENTATION  OF  THE  PLAN 

Some  of  the  monitoring  of  implementation  will  take  place  in  the  "action  meet- 
ings" suggested  above.  A  visual  display  of  a  timeline  for  accomplishment  of  various 
parts  of  the  plan  might  be  used  in  meetings  so  that  everyone  knows  how  things  are  go- 
ing. Tracking  planned  expenditures  could  also  be  helpful.  Team  members  may  need 
to  develop  new  ways  of  examining  or  displaying  the  regularly  available  data  in  order 
to  discern  trends.  In  some  cases,  display  of  the  data  could  also  be  part  of  the  effort  to 
encourage  change.  For  instance,  if  student  attendance  is  targeted  for  improvement,  a 
large  graphic  showing  attendance  rates  month-by-month  could  be  displayed  in  the 
front  hall  of  the  school. 

Schools  may  find  that  they  need  new  sources  of  data  in  order  to  do  their  ongoing 
monitoring.  For  example,  if  parent  involvement  is  a  focus  of  the  plan,  then  there  may 
need  to  be  a  systematic  accounting  of  the  numbers  of  parents  who  participate  and  their 
satisfaction  with  their  involvement.  One  straightforward  approach  is  to  count  the  num- 
ber of  parents  who  show  up  for  conferences,  meetings,  and  assemblies.  If  school  climate 
is  being  addressed,  the  school  may  want  to  survey  faculty,  students,  and  parents.    A 

BPS  R&D  A&E  -  22  9/1993 


Monitoring  the  Education  Plan  -  Ongoing  Monitoring 


more  frequent  assessment,  appropriate  for  young  children,  might  be  to  ask  them  to 
choose  one  of  5  faces  with  varying  degrees  of  a  smile  or  a  frown  to  reflect  how  they  felt 
in  school  during  that  day.  Examples  of  school  climate  surveys  which  have  been  used 
by  some  BPS  schools  are  available  from  the  Office  of  Research  and  Development.  Ap- 
pendix A  provides  a  number  of  guidelines  for  constructing  questionnaires  and  includes 
a  guide  to  other  surveys  which  are  available. 

Observation  techniques  may  be  appropriate  for  answering  certain  questions. 
For  example,  in  order  to  ascertain  how  integration  of  special  education  children  in 
regular  education  classrooms  is  proceeding,  it  may  be  necessary  to  observe  classrooms. 
The  team  may  also  wish  to  interview  teachers  in  integrated  classrooms  periodically,  in 
order  to  know  how  well  the  process  is  working  from  the  teachers'  point  of  view.  Ap- 
pendix A  contains  information  on  how  to  do  observation  and  interviewing. 

Other  data  sources  such  as  teachers'  records  and  student  grades  and  portfolios 
may  be  useful  in  ongoing  monitoring  as  well.  For  instance,  if  improving  students'  writ- 
ing ability  is  a  goal  of  the  Three- Year  Education  Plan,  portfolios  for  selected  students 
could  be  analyzed  periodically.  More  information  on  the  use  of  other  data  sources  may 
be  foimd  in  the  chapter  Assessing  Needs  under  "Other  Data  Sources". 

Collecting  new  data  can  be  time-cor\suming  and  challenging.  Given  limited  time 
and  resources,  collection  of  new  data  should  focus  on  key  issues  only.  It  is  unnecessary 
to  collect  more  data  than  a  team  can  reasonably  use. 

MONITORING  PERFORMANCE  ON  SYSTEMWIDE  INDICATORS 

With  respect  to  the  school's  performance  on  the  Systemwide  Indicators,  those  in- 
dicators which  change  during  the  course  of  the  school  year  are  the  most  appropriate  for 
ongoing  monitoring.  By  contrast,  indicators  which  occur  only  once  during  a  year  (such 
as  those  associated  with  standardized  testing)  are  inappropriate  for  ongoing  monitor- 
ing. Therefore,  the  following  indicators  are  most  amenable  to  ongoing  monitoring:  stu- 
dent attendance,  course  failures,  suspensions,  dropouts.  Special  Education  Prototype 
increases /decreases.  Special  Education  referrals,  and  staff  attendance.  The  decision 
about  which  of  these  (if  any)  require  close  monitoring  should  be  determined  by 
whether  any  of  these  is  a  problem  area  for  the  school  and  how  relevant  they  are  to 
goals  the  school  has  set. 

In  many  instances,  existing  sources  of  data  can  be  used  for  ongoing  monitoring 
of  Systemwide  Indicators.  Examples  may  include  the  regular  records  of  attendance, 
grades,  suspensions,  and  discharges  which  are  maintained  by  schools. 
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ANALYZING  AND  REPORTING  THE  DATA 

In  the  end,  data  are  useful  only  if  they  are  communicated  in  such  as  way  that 
others  can  understand  and  use  them.  This  is  a  major  challenge,  and  is  one  reason  why 
data  collection  and  reporting,  especially  for  newly-collected  data,  should  be  kept  fo- 
cused, simple,  and  straightforward.  Appendix  B  contains  information  about  basic  sta- 
tistics and  related  concepts  which  may  be  helpful  as  the  team  plans  how  to  report  data 
it  monitors.  Staff  in  the  Office  of  Research  and  Development  may  be  available  to  help 
with  questions  about  how  to  present  data. 

There  should  be  a  regular  mechanism  by  which  data  are  assembled  and  reported 
to  the  principal  or  headmaster  and  other  members  of  the  team.  As  suggested  earlier, 
some  of  the  data  may  be  suitable  for  graphical  presentation  in  a  public  place  in  the 
school. 

As  any  data  are  presented,  it  is  important  to  keep  in  mind  that  the  purpose  of 
ongoing  monitoring  is  to  aid  in  the  implementation  of  the  Educational  Plan  and  not  to 
evaluate  staff  or  programs.  It  should  be  made  clear  in  any  data  presentation  that  the  in- 
formation is  preliminary  and  tentative. 
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Schedule  of  Data  Reports  and  Documents 

SY1 994-95 


[Document  Title 


Data  Description 


Date  Disseminated 


DATA  FOR  STUDENT  DIAGNOSIS  AND  INSTRUCTION 


Longitudinal  Test  Score       I^ET  student  percentiles  for  4  years, 
Report  for  MET  and  DRP     ^^^^^  equivalents;    D.R.P.  score 


Aug.  15.  1994 


Student  Record  Labels 

MET  Individual  Student 
Report 


MET  student  percentiles  for  3  years  and  Sep.  9,  1994 

DRP  score 

Detailed  diagnostic  report  - 1  page  per  Sep.  9,  1994 

student;  focuses  on  individual  student 
strengths  and  weaknesses 


MET  Individual  Student        individual  student  percentiles  for  total  test 
Listing  (Fall,  Grades  3-5)     ^^^^  subtests 


Nov.  9,  1994 


•   D.R.P.  Test  Results 


Student  listing  D.R.P.  index  (score),  form 
taken.  Exclusion  Code 


D.R.P.   Students  Not  Yet     Student  listing  D.R.P.  index,  form  taken, 

Meeting  Promotion  Exclusion  Code 

Standard 


Oct.  5,  1994 
Jan.25,  1995 
May  22,  1995 

Oct.  5,  1994 
Jan.25,  1995 
May  22,  1995 


Aprenda  Master  List  of 
Test  Results 


student  Listing  of  Aprenda  Total  and 
Subtest  scores  (Bilingual  Students  Only). 
(Report  produced  by  Psychological  Corp.) 


Jan.  18,  1995 


MET  Individual  Student 
Listing 


Individual  student  percentiles  for  total  test 
and  subtests 


June  5,  1995 


DATA  FOR  SCHOOL  LEVEL  PLANNING 


End-of-Year  Report 


Form  for  summative  evaluation  of  educa- 
tion plan  for  the  recently  ended  school 
year  with  data  on  Systemwide  Indicators 
and  forms  for  school  level  objectives. 


Aug.  30,  1994 


MET  Receiving  School 
Report  (Available  upon 
request  by  school) 


MET  Median  Percentiles  by  Grade  (bro- 
ken down  by  race  with  interval  level  fre- 
quencies) for  students  in  school  for 
SY94-95. 


Sept.  15,  1994 
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DocumentHtle- 


Data  Description 


Date  Disseminated 


MET  Cohort  Analysis 


Report  on  student  progress  on  the  MET 
following  the  same  group  of  students  over 
two  testing  periods. 


Oct.  14,  1994 


MET  Skills  Analysis 


School  level  report  analyzing  MET  test  re- 
sults broken  down  by  specific  skill  areas 
measured  by  the  test. 


Oct.  19,  1994 


MET  Frequency  Report 
(Fall,  Grades  3-5) 

Mass.  Assessment  of 
Educational  Progress 
(M.A.E.P.)  Report 


Median  Percentiles  by  Grade  (broken 
down  by  race  with  interval  level 
frequencies) 

School  summary  reports  for  M.A.E.P.  test 
results  from  testing  in  Mar.  -  Apr.,  1994 


Nov.  9,  1994 


November  22,  1994 
(tent.) 


Mid-Year  Report 


Form  for  formative  evaluation  of  educa- 
tion plan  at  mid  year  with  data  on  System- 
wide  Indicators  and  forms  for  school  level 
objectives 


Jan.  17,  1995 


MET  Frequency  Report 


Median  Percentiles  by  Grade  (broken 
down  by  race  with  interval  level 
frequencies) 


Junes,  1995 


DATA  FOR  SYSTEM  LEVEL  PLANNING 


Annual  Systemwide 
Report  on  Performance 
Indicators 

MET  Skills  Analysis 


D.R.P.  Summary  Report- 
Students  Not  Yet  Meeting 
Promotion  Standard 

MET  Cohort  Analysis 


Mass.  Assessment  of 
Educational  Progress 
(M.A.E.P.)  Report 


Detailed  data  aggregated  by  level  and 
system  on  Systemwide  Indicators  and 
standards 

System  level  report  analyzing  MET  test 
results  broken  down  by  specific  skill  ar- 
eas measured  by  the  test. 

Totals  of  number  of  students  not  yet 
passing  the  D.R.P.  by  grade,  school, 
level,  and  system  broken  down  by 
program 

System  level  report  on  student  progress 
on  the  MET  following  the  same  group  of 
students  over  two  testing  periods. 

System  level  summary  report  for 
M.A.E.P.  test  results  from  testing  in 
Mar.  -Apr.,  1994 


Septembers,  1994 


Oct.  19,  1994 


Oct.  5,  1994 
Jan. 25,  1995 
May  22,  1995 

Oct.  14,  1994 


November  22,  1994 
(tent.) 
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Document  Title 


Data  Description 


Date  Disseminated 


Analysis  Group  Report 


Ad  Hoc  Reports  as 
Needed 


Summary  report  of  the  numbers  and  per- 
centage of  students  taking  the  MET  bro- 
ken down  by  program  and  analysis  group. 

Specific  analyses  performed  upon  re- 
quest or  as  needed  for  level  or  system 
administration 


June  15,  1995 


Periodically,  when 
required 


GENERAL  AND  PROGRAM  INFORMATION 


Boston  Public  Schools 
School  Profiles 

Chapter  1  Evaluation 
Report  SY1 993-94 


Archival  information  about  individual 
schools,  levels  and  system.  Includes  stu- 
dent, staff  and  budget  data. 

Analysis  of  implementation  and  impact  of 
Chapter  1  services. 


Mid  Oct,  1994 


9/15/94  (to  Chapter  1 
Director) 


'  Computer  printout  reports  are  produced  by  the  Office  of  Technology  and  Infonnation  Services 
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Intervention 


Inter^^ention  is  a  process  by  which  schools  receive  outside  help  in  order  to  im- 
prove. As  detailed  in  the  contents  of  this  section,  intervention  is  initiated  either  by  a 
Assistant  Superintendent  or  by  appropriate  members  of  the  school  community.  The  in- 
tervention is  carried  out  by  a  School  Intervention  Team  which  visits  the  school,  assesses 
the  problems  and  the  potentials,  and  makes  recommendations.  Thus,  intervention  is 
positioned  in  the  "Assess  Needs"  part  of  the  plaiming  cycle.  However,  since  an  inter- 
vention could  be  requested  at  any  time,  it  does  not  occur  on  the  same  three-year  timeta- 
ble as  the  rest  of  the  school  plaiining  process. 

Intervention  may  be  triggered  by  a  school's  sustained  poor  performance  relative 
to  systemwide  indicators  or  by  its  failure  to  meet  its  own  goals  and  objectives  or  other 
problems  with  its  planning  process.  In  addition,  other  issues  identified  by  the  Assistant 
Superintendent,  such  as  poor  staff  relationships,  can  lead  to  intervention. 

Details  concerning  the  intervention  process  are  provided  in  the  Intervention 
Team  Manual  which  was  prepared  for  the  use  of  Intervention  Team  members  in  the 
1992-1993  school  year.  This  document  contains  information  on  the  organization  of  a 
team's  work,  the  use  and  interpretation  of  the  various  sources  of  data  concerning  an  in- 
tervention school,  preparing  for  and  conducting  school  visits,  preparing  the  team's  re- 
port, and  evaluating  the  team's  own  work  and  the  intervention  process.  Copies  of  the 
Intervention  Team  Manual  are  available  from  the  Office  of  Research  and  Development. 

Teams  are  expected  to  cover  ten  steps  in  accomplishing  their  work. 

Stqj  1.  Initial  Training  and  Organization.  This  involves  the  training  workshop  for 
each  Level  at  which  time  the  activities  each  Team  member  will  be  participating  in  are 
explained  in  detail.  An  Intervention  Team  Manual  and  School  Performance  Portfolio 
specific  to  the  team  member's  intervention  school  is  given  to  each  team  member.  Fol- 
lowing the  training  workshop,  teams  gather  in  their  group,  exchange  introductioris  and 
then  select  one  member  to  serve  as  a  team  leader  and  one  member  to  serve  as  a  team  re- 
cord keeper. 

Step  2.  Review  School  Portfolio.  Once  the  team  structure  is  organized,  each  team 
member  individually  familiarizes  himself  or  herself  with  the  contents  of  the  Interven- 
tion School  Performance  Portfolio.  This  collection  contains  extensive  data  on  the  school 
to  be  reviewed.  Documents  include  the  Assistant  Superintendent's  rationale  for  assign- 
ing the  school  to  Intervention,  the  Three- Year  Education  Plan,  the  End-of-Year  Report, 
the  Midyear  Progress  Report,  School  Profiles  pages,  and  the  Massachusetts  Educational 
Assessment  Program  results. 
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Step  3.  Preparing  for  School  Visits.  Before  actually  visiting  the  school,  the  team  or- 
ganizes the  focus  of  inquiry  to  be  conducted  at  the  school.  This  focus  emerges  from  the 
reading  of  the  Assistant  Superintendent's  Rationale  for  Intervention,  examining  the  data 
concerning  the  issues  raised  by  the  Assistant  Superintendent,  and  any  other  points  of 
information  that  seem  relevant.  Once  the  group  is  clear  as  to  what  needs  to  be  ex- 
amined further  at  the  school,  the  team  decides  who  needs  to  be  interviewed  or  observed 
and  when  might  be  the  best  time  to  conduct  the  interview  or  observation.  This  is  a  ten- 
tative scheduling;  it  probably  does  not  include  specific  names  but  rather  categories  such 
as  specific  parent  groups,  reading  teachers,  etc. 

Step  4.  Meet  with  Principal  or  Headmaster  &  Faculty  Representative.  At  this  time  the 
Team  reviews  their  questions  and  inquiry  strategy  so  that  the  school  representatives 
may  assist  the  Team  in  scheduling  specific  interviews  and  observations.  Either  the  prin- 
cipal or  headmaster,  or  faculty  representative  might  suggest  alternative  or  additional 
questions  or  strategies  to  pursue. 

Step  5.  School  Visit  by  full  Team.  This  phase  is  characterized  by  two  distinct  parts. 
The  first  part  consists  of  the  first  actual  whole  Team  site  visit.  EXiring  this  time  the 
Team  members  take  a  brief  tour  of  the  school  facilities,  are  introduced  to  the  entire 
school  staff  in  order  that  aU  school  community  members  are  aware  of  the  Team's  pres- 
ence and  may  assist  Team  members  in  all  reasonable  ways.  Then,  either  in  groups  or 
individually  (predetermined  during  organizational  meetings),  the  Team  begins  the 
work  of  examining  the  underlying  structures  and  dynamics  of  the  school  through  all 
reasonable  means. 

Toward  the  end  of  the  day,  the  Team  members  regroup  to  exchange  experiences, 
discuss  implications,  and  strategize  for  the  Pair  Visits  to  be  conducted  the  next  week. 

Step  6.  School  Visit  by  Pairs.  This  is  an  opportunity  to  follow  up  and  delve  more 
deeply  into  issues  and  activities  witnessed  during  the  group  visit  or  brought  up  during 
data  review  sessions.  At  the  end  of  the  visit  ,  pairs  meet  privately  to  compose  their 
group  notes  on  the  day's  findings.  This  is  generally  the  last  opportunity  for  on-site  ob- 
servation a  Team  member  wiU  have. 

Steps  7  &  8.  Preparation  of  Report.  The  final  Report  preparation  begins  with 
each  Team  Pair  presenting  their  findings  verbally  to  the  rest  of  the  group.  Then  the 
Team  as  a  whole  sifts  through  the  broad  spectrum  of  information  "laid  on  the  table"  to 
begin  to  make  some  sense  of  the  data  and  shape  and  select  those  findings  that  shed  the 
most  light  on  the  issues  and  problems  motivating  the  Intervention  process.  These  find- 
ings are  delimited  and  suntmarized. 

Next,  a  report  is  drafted  from  the  findings  and  a  set  of  recommendations  is  pro- 
posed that  aim  at  moving  the  school  into  a  more  successful  trajectory.  This  draft  Report 
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and  Recommendations  is  then  sent  to  the  School  Administration  and  Faculty  for  their 
review  and  comment. 

Step  9.  Meet  with  School  Administration  and  Faculty  to  review  draft  Report.  Once  the 
School  Administration  and  Faculty  have  reviewed  the  draft  Report,  the  Team  as  a 
whole  sits  and  discusses  relevant  points  brought  up  by  school  personnel.  This  is  an  op- 
portimity  for  the  school  to  respond  to  factual  errors  that  may  appear  in  the  Report  and 
to  make  suggestions  or  contributions  on  the  set  of  recommendations. 

Step  10.  Final  Report.  The  Team  takes  the  recommendations  and  suggestions  of- 
fered by  school  personnel  and  retreats  to  a  quiet  room  at  the  Assistant  Superintendent's 
Office  to  consider  the  school  level  input  and  compose  the  Final  Report.  The  Assistant 
Superintendent's  Office  may  provide  assistance  in  the  preparation  of  the  final  manu- 
script. The  Final  Report  is  submitted  to  the  Assistant  Superintendent  in  May. 


There  are  four  documents  in  this  section.  The  first  reproduces  the  contents  of  Su- 
perintendent's Circular  No.  24, 1992-1993  (dated  September  24,  1992),  titled  "School  In- 
tervention Team:  Purposes,  Membership,  and  Procedures."  The  second  is  a  list  of 
possible  criteria  to  be  used  in  determining  the  need  for  an  intervention.  It  is  not  meant 
to  be  exhaustive,  but  to  provide  examples.  The  third  document  is  a  chronology  of  the 
School  Intervention  Process.  Finally,  the  fourth  document  is  a  suggested  form  for 
Assistant  Superintendents  to  use  in  recommending  a  school  for  intervention. 
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SCHOOL  INTERVENTION  TEAM' 


Purposes,  Membership,  and  Procedures 


The  focus  of  the  School  Intervention  Team  is  on  the  school  as  an  institution  and 
the  major  goal  of  the  Team  is  to  assist  in  improving  the  school  or,  barring  that,  to  identi- 
fy specific  barriers  to  school  improvement.  A  School  Intervention  Team  may  be  as- 
signed to  a  school  in  two  ways  ~  as  a  result  of  an  external  decision  and  as  a  result  of  an 
internal  decision.  The  external  decision  to  assign  a  School  Intervention  Team  is  the  re- 
sponsibility of  the  Zone  Superintendent  and  should  be  made  only  after  he  or  she  has 
collected  and  analyzed  the  school's  performance  on  system-wide  indicators  and  in  rela- 
tion to  its  annual  school  plan.  This  decision  shovild  be  reserved  for  those  schools  that 
are  in  need  of  improvement  and,  in  the  professional  judgment  of  the  Zone  Superinten- 
dent, are  unlikely  to  improve  without  outside  assistance  and  intervention. 

Alternatively,  an  internal  decision  might  be  made  when  a  school  recognizes  that 
it  needs  additional  guidance  in  order  to  improve  and  requests  the  assistance  of  a  School 
Intervention  Team.  Such  requests  must  come  from  the  principal /headmaster  or  from  a 
recogiuzed  school  group  such  as  the  Faculty  Senate,  the  School-Parent  Council,  or  the 
School  Site  Council.  All  such  requests  must  be  transmitted  though  the  principal /head- 
master who  is  responsible  for  commenting  on  the  request  when  he  or  she  submits  it  to 
the  zone  office.  Zone  Superintendents  wiU  consider  the  merits  of  each  request  and  may 
grant  or  deny  the  request,  solicit  more  information,  or  provide  assistance  through 
means  other  than  a  School  Intervention  Team. 

I.    PURPOSES  OF  SCHOOL  INTERVENTION  TEAMS 

Schools  will  be  assessed  annually,  comparing  performance  to  goals  beginning  in  June  1990. 

Schools  whose  performance  is  unsatisfactory  will  be  responsible  for  detailing  a  plan  for 
improvement  in  their  next  Annual  Education  Plan.  In  addition,  schools  whose  performance  is 
evaluated  as  unsatisfactory  by  the  Zone  Superintendent  based  upon  the  criteria  established  by  the 
School  Based  Management  Committee  and  the  school's  Annual  Education  Plan  would  be  subject  to 
review  and  assistance  by  a  School  Inten/ention  Team  that  could  recommend  appropriate  improvement 
measures,  including  but  not  limited  to: 

o    additional  time  to  attempt  improvement,  but  not  more  than  one  year; 

o     intensive  monitoring; 
~  o    assignment  of  part-time  or  full-time  in-school  specialists  or  consultants; 

o    specialized  staff  development; 

o     reallocation  of  staff  duties; 

o    replacement  of  some  or  all  of  the  leadership  team; 

o    reassignment  of  some  or  all  BTU-member  staff. 

'      Reproduced  from  Superintendent's  Circular  No.  24, 1992-1993  (Dated  September  24, 1992). 
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Schools  whose  (jertormance  is  unsatisfactory  can  also  request  intervention  from  a  School 
Intervention  Team  to  help  them  formulate  and  implement  an  improvement  plan  (c.f.  Boston  Teachers 
Union  Collective  Bargaining  Agreement). 

In  short,  the  School  Intervention  Team's  primary  task  will  be  to  identify  specific 
actions  for  school  improvement. 

II.    MEMBERSHIP  OF  THE  TEAMS 


"The  School  Intervention  Team  will  be  composed  of  three  members  chosen  by 
the  BTU  and  three  members  selected  by  the  Zone  Superintendent  and  appointed  by  the 
Superintendent  "  (c.f.  Boston  Teachers  Union  Collective  Bargaining  Agreement).  In 
addition,  the  Zone  Superintendent  is  required  by  contract  to  appoint  one  BASAS  mem- 
ber to  the  Team.  The  BTU  and  Zone  Superintendents  are  not  required  to  name  current 
Boston  Public  School  employees  to  the  School  Intervention  Teams  and  may  select  Team 
members  who  are  not  employees  of  the  Boston  Public  Schools,  such  as  community  lead- 
ers, parents,  university  employees,  business  executives,  and  retired  teachers  and  princi- 
pals/headmasters. Regardless  of  the  composition  of  the  Teams,  each  Team  member  is 
expected  to: 

•  become  familiar  with  Boston's  strategic  planning  process,  including  system-wide 
indicators; 

•  become  familiar  with  Boston's  standards  for  school  performance; 

•  have  excellent  observational  techniques; 

•  have  the  ability  to  function  as  a  member  of  a  team;  and 

•  attend  a  one-half  day  training  and  orientation  session. 

In  selecting  individuals  to  serve  on  the  Teams,  the  Zone  Superintendents  and 
the  BTU  will  consider  the  impact  teachers'  or  administrators'  absences  will  have  on  their 
ability  to  fulfill  their  regular  assignments.  In  all  cases,  the  Superintendent  will  review 
all  recommendations  to  ensure  that  members  are  imbiased  and  representative  of  the 
school  and  community. 

The  Zone  Superintendents  will  provide  staff  resources  to  the  School  Intervention 
Team  to  enable  it  to  have  access  to  appropriate  data  and  data  analyses,  information 
about  curriculum,  and  any  other  material  the  Zone  Superintendent  thinks  will  enable 
the  Team  to  carry  out  its  tasks. 

Zone  Superintendents  and  representatives  of  the  BTU  and  BASAS,  with  the  as- 
sistance of  the  Measurement  Committee  of  the  Boston  Compact,  will  be  responsible  for 
designing  and  monitoring  training  and  orientation  for  the  School  Intervention  Teams. 
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III.  THE  INTERVENTION  PROCESS 

All  School  Intervention  Teams  will  follow  the  same  format  initially.  This  four 
week  effort  will  seek  to  identify  specific  areas  in  which  schools  need  to  improve,  identi- 
fy the  factors  that  enhance  or  impede  progress,  and  make  recommendations  for  school 
improvement.  Service  on  a  School  Intervention  Team  will  require  each  individual  to 
serve  a  total  of  five  and  one  half  days  over  a  four  week  period.  Members  must  be  able 
to  manage  their  own  child  care. 

The  following  outlines  the  Teams'  primary  activities  by  week: 

Week  1:  One  half  day  organizational  meeting  with  zone  officials  and  as  a  Team, 

one  complete  day  school  visit  by  the  complete  Team.  The  school  visit 

will  include  interviews  with  school  personnel,  students,  and  parents  as 

well  as  direct  observations.  Ideally,  the  half  day  meetings  and  school 

visits  will  be  scheduled  on  the  same  day. 
Week  2:  One  day  school  visit  by  Team  members  in  pairs;  this  "day"  may  be  done 

in  two  half  day  visits;  ideally.  Teams  will  arrange  to  cover  different 

times  of  the  day  and  different  days  of  the  week. 
Week  3:  One  half  day  to  review  and  write  the  findings  of  the  visits.  One  half  day 

to  review  the  findings  with  the  school  administration.  One  half  day 

school  visit  in  pairs. 
Week  4:  One  half  day  to  rewrite  the  findings  and  draft  recommendations.  One 

half  day  to  review  reconimendations  with  administrators  and  write  final 

recommendations. 

At  the  conclusion  of  the  four  week  period,  the  School  Intervention  Team  will 
submit  a  written  report  to  the  Zone  Superintendent.  Recommendations  of  the  Team  are 
reached  by  a  majority  vote.  In  addition  to  recommending  programmatic  changes,  the 
Team  may  recommend  to  the  Zone  Superintendent  that  the  school  continue  to  imple- 
ment its  improvement  plan: 

•    with  no  further  monitoring; 

with  monitoring  for  a  period  not  to  exceed  six  months; 

with  monitoring  for  a  period  of  between  six  months  and  one  year. 


• 


These  three  possibilities  are  discussed  below. 

CONTINUE  WITH  NO  FURTHER  MONITORING:  In  those  instances  when  the  School 
Intervention  Team  concludes  that  a  school  is  making  significant  progress  and  has  the 
resources,  leadership  and  staff  necessary  to  continue  that  improvement,  the  Team  may 
recommend  specific  areas  in  which  improvement  is  needed  and  recommend  to  discon- 
tinue its  monitoring  task. 

MONITORING  FOR  A  PERIOD  NOT  TO  EXCEED  SEX  MONTHS:  In  those  instances  when 
the  School  Intervention  Teani  concludes  that  the  school  is  making  some  progress  but 
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may  not  be  using  its  resources,  leadership  and /or  staff  effectively  and  is,  therefore,  iin- 
able  to  continue  to  advance  alone,  the  School  Intervention  Team  may  recommend  that  it 
continue  its  monitoring  over  a  relatively  short  period  (one  to  six  months).  Members  of 
the  School  Intervention  Teams  will  continue  to  serve  throughout  the  monitoring  stage. 
Should  the  Zone  Superintendent  accept  this  recommendation,  he  or  she,  with  the  assis- 
tance of  the  Team,  is  responsible  for  designing  a  plan  to  monitor  the  school;  this  plan 
must  allow  Team  members  to  continue  to  perform  their  duties.  The  Team  will  also  be 
responsible  for  identifying  those  specific  areas  in  which  improvement  is  needed;  such 
recommendations  will  provide  the  focus  of  the  Team's  continued  monitoring. 

MONITORING  FOR  A  PERIOD  OF  BETWEEN  SIX  MONTHS  AND  ONE  YEAR:  In  those  in- 
stances when  the  School  Intervention  Team  concludes  that  the  school  is  making  limited 
or  no  progress  and  lacks  the  ability  to  use  and  manage  effectively  its  resources,  or  lacks 
the  leadership  and /or  the  staff  necessary  to  improve  over  a  short  period  of  time,  the 
Team  may  recommend  continued  monitoring  over  a  period  of  time  between  six  months 
and  one  year.  Should  the  Zone  Superintendent  accept  this  reconimendation,  he  or  she, 
with  the  assistance  of  the  Team,  is  responsible  for  desigrung  a  plan  to  monitor  the 
school;  this  plan  must  allow  Team  members  to  continue  to  perform  their  duties.  The 
Team  will  also  be  responsible  for  identifying  those  specific  areas  in  which  improvement 
is  needed;  such  recommendations  will  provide  the  focus  of  the  Team's  continued 
monitoring. 

IV.  PROCEDURES 


When  submitting  the  recommendation  for  assigning  a  School  Intervention  Team 
to  a  school  to  the  Superintendent,  the  Zone  Superintendent  will  also  present  the  charge 
to  the  Team  which  will  include  target  dates  for  submission  of  interim  and  final  reports 
as  well  as  a  detailed  description  of  the  Team's  major  tasks.  The  Zone  Superintendent 
will  provide  each  Team  with  data  describing  the  school's  performance  on  the  system- 
wide  indicators,  on  the  school's  specific  goals,  and  her/his  rationale  for  appointing  the 
Team. 

Once  trained  and  orientated,  the  Team  wiU  select  one  person  to  act  as  chair  and 
set  up  a  schedule  for  school  visits.  Team  meetings  and  reports. 

Team  members  will  submit  to  the  chair  written  notes  after  every  school  visit, 
after  every  meeting  with  school  persormel,  and  after  every  Team  meeting.  Initial  school 
visits  and  meetings  with  school  personnel  must  be  scheduled  at  least  two  days  in 
advance.  When  the  School  Intervention  Team  has  completed  its  work,  it  will  submit  a 
report  to  the  Zone  Superintendent.    The  Zone  Superintendent  is  responsible  for 
deciding  whether  to  accept  the  recommendations  of  the  Team.  However,  if  a  Team  is 
deadlocked  3-3  on  a  proposal  for  staff  reassignment,  that  school  will  have  an  additional 
year  to  improve  its  performance.  At  that  time,  a  new  School  Intervention  Team  will  be 
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appointed  and  a  seventh  member,  who  is  jointly  agreed  to  by  the  Superintendent  and 
the  President  of  the  BTU,  will  be  added. 

The  recommendations  of  the  School  Intervention  Team  are  considered 
administrative  documents  and  may  be  released  to  parents  or  staff  of  the  school  in 
question  only  with  the  approval  of  the  Zone  Superintendent.  Should  the  School 
Intervention  Team  recommend  a  realignment  of  a  school's  leadership  teani  or  the 
reassignment  of  any  BTU  or  BASAS  member,  applicable  contractual  procedures  must 
be  followed. 

The  Zone  Superintendent  will  make  recommendations  to  the  Superintendent 
based  on  the  report  of  the  School  Intervention  Team.  These  reports  will  be  treated  in 
accordance  with  established  School  Committee  rules  and  regulations. 

Any  questions  should  be  directed  to  your  Zone  Superintendent. 
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Criteria  for  Intervention 


The  Boston  Teachers  Union  Collective  Bargaining  Unit  Agreement  calls  for  the 
establishment  of  School  Intervention  Teams  to  work  with  those  schools  which  are  in 
particular  need  of  improvement.  The  evaluation  of  the  schools  is  based  on  school  per- 
formance relative  to  the  Education  Plan  developed  by  the  school  and  relative  to  the  in- 
dicators established  by  the  Compact  Measurement  Conunittee.  Assistant 
Superintendents  may  identify  schools  that  need  intervention  or  schools  may  volunteer 
for  additional  assistance.  The  following  criteria  for  intervention  are  in  keeping  with  the 
spirit  of  the  process.  Schools  should  be  evaluated  according  to  the  following  criteria: 

•  relative  to  systemwide  indicators 

•  pattern  of  decrease  over  time 

•  failure  to  make  progress  over  time 

•  consistently  below  standards 

•  failure  to  attract  students 

•  relative  to  school  level  goals  and  objectives 

•  failure  to  reach  goals 

•  setting  of  inappropriate  goals 

•  failure  to  make  progress  toward  goals 

•  other  issues  as  identified  by  the  Assistant  Superintendent 
examples  include: 

transfers  of  teachers  or  students 

how  the  school  is  working  with  unique  populations 

school  needs  outside  resources  to  change  or  hasten  the  change  process 

inability  to  work  as  a  team  -  poor  staff  relationships 

general  parental  dissatisfaction  with  school 

inability  to  maintain  an  educational  environment  conducive  to  teaching  and 

learning 
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Sample  Chronology  of  the  School  Intervention  Process 


Taken  From  Timetable:  School  Year  1992  - 1993 


Development  of  criteria  for  intervention 


Identification  of  schools  for  intervention 


12/2/92 
1/19/93 


Selection  of  intervention  teams 


3/1/93 


Initial  training  session  for  intervention  teams 

Zone  level  training  sessions  for  intervention  teams 

Teams  begin  work  in  schools 

Ongoing  technical  assistance  of  teams  and  zone  staff  support  to 
assist  with  arrangements 

Team  reports  to  Zone  Superintendents 

Completion  of  report  and  follow-up  as  determined  by  Zone 
Superintendent 

Review  of  team  reports 


Recommended  action  by  Zone  Superintendents 


week  of  3/22/93 

week  of  3/29/93 

3/29/93 

■  3/29/93  to 
4/30/93 

5/21/93 

5/17/93  to 
5/24/93 

5/24/93  to 
5/31/93 

6/1/93 
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Intervention  -  Rationale  for  intervention  Form 


Priority  Status  for 
Intervention  SY92-93 

□  Higli  □  Middle  □  Low 


School  Intervention  Process: 
Rationale  and  Foundations  for  Improvement 

School:    Level:      


Rationale  for  Intervention:  Present  the  reason  (s)  why  the  school  was  chosen  for  or  requested 
intervention.  Include,  as  appropriate,  infonmation  relative  to  systemwide  indicators,  school  level  goals 
and  objectives  and  other  issues  as  identified  by  the  Assistant  Superintendent. 


Foundations  for  Improvement:  identify  those  positive  elements  of  the  school  that  may  serve 
as  a  starting  point  for  school  improvement  (e.g.,  faculty  experience,  parental  support,  school  climate, 
etc.). 
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Appendix  A:  Guidelines  for  Constoicting  and  Using  Questionnaires  and  Surveys 

Guidelines  for  Constructing  and  Using 
Questionnaires  and  Surveys 

The  last  section  of  this  appendix  contains  a  review  of  surveys  in  a  wide  range  of 
areas.  It  may  be,  however,  that  none  of  the  examples  is  suitable  for  a  school's  purposes, 
or  that  the  cost  of  commercially  available  surveys  is  prohibitive.  Then,  an  originally 
constructed  questionnaire  may  be  used.  Writing  questionnaires  and  surveys  is  some- 
thing of  an  art.  The  following  guidelines  should  help.  In  addition,  staff  in  the  Office  of 
Research  and  Development  may  be  available  to  review  proposed  questionnaires. 

1.  Ask  only  what  you  need  to  know!  Data  from  questionnaires  can  quickly  become 
overwhelming  -  too  much  to  process  and  understand.  Keep  it  as  brief  and  as 
simple  as  possible.  Be  clear  on  how  you  intend  to  use  the  data  to  make  decisions. 

2.  Use  simple  and  straightforward  language,  paying  attention  to  the  reading  level 
of  your  intended  respondents.  Use  short,  clear  sentences. 

3.  Ask  questions  which  respondents  naight  reasonably  know  something  about,  or 
have  an  opinion  about.  In  many  circumstances,  it  is  appropriate  to  have  a  "Don't 
Know"  or  "Have  no  Opinion"  response  option,  so  that  people  answering  the  sur- 
vey do  not  feel  backed  into  a  comer,  and  don't  therefore  give  arbitrary  answers. 

4.  Avoid  "double-barreled"  items  which  really  ask  two  questions  at  once.  (This 
mistake  is  common,  even  on  professionaUy  designed  surveys).  A  fairly  obvious 
example  of  a  double-barreled  question  is:  "Do  you  agree  or  disagree  that  the  rate 
of  drug  use  nowadays  is  higher  than  it  was  10  years  ago  because  children's  par- 
ents are  providing  inadequate  supervision?"  If  a  person  disagrees  with  this  state- 
ment, there  is  no  way  to  know  whether  they  disagree  with  the  premise  that  drug 
use  is  higher  now  than  it  was  or  they  disagree  with  the  explanation  given. 

5.  Avoid  overlapping  categories  provided  for  the  respondent.  This  mistake  can  oc- 
cur in  specifying  ranges  of  numbers  for  a  respondent  to  choose.  For  example,  if 
one  asks  parents  to  indicate  the  age  of  their  children,  and  the  ranges  provided 
are  0-5,  5-10,  10-15,  and  15-20,  the  parent  of  a  5, 10,  or  15  year  old  will  not  know 
how  to  respond. 

6.  Limit  the  number  of  open-ended  questions  (ones  in  which  people  write  out  an 
answer,  as  opposed  to  checking  or  circling  an  alternative).  While  the  results 
from  open-ended  questions  may  be  richer  than  those  from  closed-ended  ques- 
tions, they  have  some  significant  disadvantages.  First,  they  can  be  hard  to  read 
and  understand.  Second,  reading  and  summarizing  more  than  a  few  can  quickly 
become  an  overwhelming  task.  "Content  analysis",  in  which  the  themes  emerging 
from  the  answers  are  identified,  is  not  easy. 

The  advantages  of  including  one  or  two  open-ended  questior\s  are  as  follows:  a) 
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they  permit  people  to  express  their  feelings  more  fully;  and  b)  they  allow  for  the 
expression  of  opinions  or  reactions  whic±i  were  not  anticipated  by  those  who  de- 
signed the  questionnaire.  Respondents  can  appreciate  not  having  their  range  of 
response  limited. 

7.  Once  you  have  a  draft  of  a  questionnaire,  it's  a  good  idea  to  pretest  it,  preferably 
with  some  people  similar  to  those  who  will  eventually  receive  the  final  version  of 
the  questiormaire.  This  process  usually  reveals  problems  you  didn't  anticipate, 
and  gives  you  a  chance  to  revise  items  for  clarity,  etc.  It  is  also  necessary  to  write 
an  introduction  to  the  questionnaire,  instructions,  etc.  These  should  be  reviewed 
ahead  of  time  as  well. 

8.  Consider  how  you  will  assure  that  the  people  you  question  will  be  representative 
of  the  group  that  you  wish  to  target.  For  instance,  if  you  distribute  a  question- 
naire to  parents  in  English  only,  parents  who  speak  other  languages  will  be  less 
likely  to  retvim  the  questionnaire.  This  means  that  their  voice  will  not  be  heard, 
and  you  will  get  an  incomplete  picture  of  the  situation  in  your  school. 

9.  Once  the  questionnaire  is  complete,  consider  how  it  will  be  admiriistered.  Will  it 
be  anonymous?  What  procedures  will  there  be  for  issuing  reminders  for  people 
to  return  the  questionnaire?  Who  will  have  access  to  the  data  before  they  are 
simimarized? 

10.  Consider  how  the  data  will  be  summarized  and  reported.  Here,  too,  the  ap- 
proach should  be  simple  and  straightforward.  For  many  purposes,  it  will  be 
enough  to  simply  count  the  nimiber  and  percentage  of  respondents  who  an- 
swered each  item  in  a  given  way.  For  example,  the  following  is  a  simrunary  of  re- 
plies to  a  relatively  simple  question  which  was  given  to  200  people  (the  data  are 
made  up,  of  course): 


"Do  you  like  eating  liver? 


N 

Yes 

No 

Did  not 
Answer 

N 
% 

70 
35% 

120 
60% 

10 
5% 

More  about  calculating  simple  statistics  and  analyzing  report  data  may  be  found 
in  Appendix  B:  Statistical  Procedures. 
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Types  of  Closed  Format  Items  on  Questionnaires  and  Surveys 

(Note:  This  section  owes  some  of  its  ideas  and  materials  to  Henerson,  M.  D., 
Morris,  L.  L,  &:  Fitz-Gibbon,  C.  T.  (1978),  How  to  Measure  Attitudes,  Beverly  Hills:  Sage 
Publicatioris) 

1.  Checklists 

In  this  type  of  question,  the  respondent  is  presented  with  a  number  of  alterna- 
tives and  asked  to  check  as  many  as  apply. 

Example:  Which  of  the  following  activities  for  parents  have  you  attended  in  the  past 
year?  Check  as  many  as  apply. 

open  houses 

meetings  with  my  child's  teacher 

workshops 

(etc.) 

In  constructing  such  an  item,  it  is  important  to  make  sure  that  all  the  reasonable 
alternatives  are  included.  It  is  often  appropriate  to  have  an  alternative  called 
"other",  with  space  for  the  respondent  to  specify  what  he  or  she  had  in  mind. 

2.  Two-Way  Questions 

This  format  is  characterized  by  giving  the  respondent  a  dichotomous  choice: 
yes/no,  approve/ disapprove,  for/against,  true/false,  favor /oppose,  etc.  Some- 
times a  "don't  know"  or  "no  opinion"  option  is  also  given. 

Example:  Do  you  agree  or  disagree  that  there  should  be  more  than  180  days  in  the 
school  year?  Place  a  check  mark  next  to  your  answer. 

agree 

disagree 

no  opinion 


This  type  of  item  can  work  if  it  is  straightforward  and  clear,  and  avoids  double- 
barreled  wording. 

Multiple  Choice 

There  are  a  wide  variety  of  multiple-choice  formats,  but  all  of  them  ask  the  re- 
spondent to  mark  only  ONE  of  the  alternatives  given. 

Example  (adapted  from  Henerson,  et  al.):   How  do  you  feel  about  the  new  parent  pro- 
gram? Mark  the  answer  that  best  expresses  how  you  feel. 

It's  fine  the  way  it  is. 

It  needs  some  modification. 

It  needs  extensive  modification 

It's  not  worth  saving. 

Other  (explain) 
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4.  Ranking  Scales 

In  this  type  of  question,  the  respondent  is  asked  to  assign  priority  among  a  lim- 
ited number  of  items.  In  general,  the  number  of  items  should  be  no  more  than 
five.  This  format  can  be  helpful  in  a  situation  where  choices  must  be  made 
among  alternatives. 

Example:  The  Parent  Comnnittee  has  the  funds  to  offer  one  workshop  for  parents  next 
sennester.  What  follows  Is  a  list  of  the  five  available  topics.  Put  a  '1 '  next  to  the  one  that 
you  would  most  like  to  see  offered,  a  '2'  next  to  the  one  you  would  like  second  best,  and 
so  on.  The  one  that  you  would  like  the  least  you  should  mark  with  a  '5'.  Please  don't 
give  the  same  ranking  to  more  than  one  topic  (no  ties). 

How  to  Help  your  Child  with  Homework 

Health  Education  in  the  Home 

How  to  Solve  Conflicts  with  your  Child 

How  to  Talk  with  your  Child  about  Sexuality 

How  to  deal  with  the  new  School  Choice  Plan 

5.  Rating  Scales 

These  include  a  wide  variety  of  items  in  which  the  respondent  can  express  de- 
grees of  a  particular  response  such  as  agreement  or  disagreement.  Such  items 
are  often  used  to  learn  about  respondents'  attitudes  toward  various  topics.  This 
approach  differs  from  ranking  scales  in  that  the  different  items  are  not  in  direct 
competition  with  each  other. 

Example:  The  Parent  Committee  is  deciding  which  workshops  to  offer  next  semester, 
and  we  want  to  know  your  opinion.  For  each  of  the  following,  please  rate  how  important 
you  feel  it  is  for  each  of  the  following  topics  to  be  offered  next  semester.  Please  use  the 
following  scale  to  indicate  your  response: 

1  -  Very  important  4  -  Slightly  Important 

2  -  Important  5  -  Not  at  all  important 

3  -  Somewhat  Important 

How  to  Help  your  Child  with  Homework 

Health  Education  in  the  Home 

How  to  Solve  Conflicts  with  your  Child 

How  to  Talk  with  your  Child  about  Sexuality 

How  to  deal  with  the  new  School  Choice  Plan 

Other  (please  specify) 


In  this  example,  all  of  the  items  are  rated  independently,  so  it  is  possible 
(although  unlikely)  that  each  could  be  given  the  highest  rating  (1),  or  each  could 
be  given  the  lowest  rating  (5). 

This  kind  of  item  is  often  used  to  find  out  people's  degree  of  agreement  or  dis- 
agreement with  a  given  position.  Using  the  content  of  an  earlier  example,  this 
approach  is  illustrated  below: 
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Please  use  the  rating  scale  below  in  order  to  indicate  how  strongly  you  agree  or  dis- 
agree with  the  following  statements: 

1  -  Strongly  Agree  4  -  Disagree 

2  -  Agree  5  -  Strongly  Disagree 

3  -  Uncertain 

There  should  be  more  than  180  days  in  the  school  year. 

(etc.) 

In  some  instances,  it  may  be  preferable  to  force  a  choice,  and  leave  out  the 
middle  category  ("uncertain"). 
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Observing 


WHY  USE  OBSERVATIONS? 


Observation  is  a  method  whereby  one  can  get  a  direct  experience  of  the  school, 
not  filtered  through  the  words  of  anyone  else.  If  it  is  well  done,  observation  can  provide 
vital  information  obtainable  in  no  other  way.  However,  it  is  time-consuming  and  diffi- 
cult to  do  well. 


WHAT  SHOULD  OBSERVERS  LOOK  FOR? 

This  question  is  of  course  tied  to  the  issues  of  greatest  interest  for  the  plan.  For 
instance,  if  school  climate  is  a  concern,  then  settings  such  as  the  lunchroom,  assemblies, 
and  other  nonclassroom  activities  would  be  important  to  observe  in  addition  to 
classrooms. 

Time  to  do  observations  will  inevitably  be  limited.  To  make  the  most  of  their  lim- 
ited observation  time,  team  members  will  need  to  specify  the  major  focal  points  before 
they  start  observing.  These  should  be  clearly  specified  so  that  each  observer  knows 
what  to  look  for.  Observers  in  a  given  setting  should  limit  the  scope  of  what  they  are 
observing.  For  instance,  in  classroom  observation,  one  person  could  be  responsible  for 
observing  students'  behavior  and  involvement  during  classes  while  another  might  con- 
centrate on  the  teachers'  actions. 


Selected  General  Observational  Categories^ 


•  Classroom  Environment 

•  Classroom  Organization 

•  Interpersonal  Understanding 

•  Values 

•  Student  Autonomy 

•  Student  Cooperation 

•  Behavior  /  Academic  Activity 
Management 

•  Teacher's  Questioning  Techniques 


Teacher's  Statements  about  the  Activity 

Teacher's  Activity  While  Students  are 
doing  their  own  work 

Content  Covered  in  Large/SmaU  Group 
Activity 

Student  Behavior  Toward  Teacher 

Student  Behavior  Toward  Peers 

Student  Involvement  in  Class  Activities 

Student  Involvement  in  Small  Group 
Activities 

Student  Involvement  while  working 
alone 


Topics  adapted  from  the  Child  Development  Project:  Classroom  Observation  Form  - 1992 
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WHEN  SHOULD  OBSERVATIONS  BE  DONE? 

The  timing  of  the  observations  will  need  to  be  decided  in  consultation  with  the 
school's  principal/headmaster  and  with  those  who  will  be  observed.  EspeciaUy  in 
classrooms,  those  being  observed  should  have  a  reasonable  understanding  as  to  what 
the  observation  is  intended  to  accomplish.  In  addition,  while  teachers  and  other  school 
persormel  should  accommodate  observers  whenever  possible,  observers  should  also  re- 
spect teachers'  and  students'  privacy 

In  some  cases,  the  issue  of  concern  will  determine  the  timing  of  observations.  If 
an  elementary  school  is  concerned  about  its  relationship  with  parents,  then  some  ob- 
servation would  need  to  be  scheduled  at  the  beginning  and  end  of  the  school  day. 
However,  if  issues  such  as  attendance  and  suspensions  are  of  concern  to  the  teams,  ob- 
servation should  occur  in  a  wide  variety  of  times  and  days.  Obviously,  if  the  purpose 
of  the  observation  to  see  how  teachers  conduct  certain  tj^es  of  lessons,  the  observation 
times  should  be  scheduled  to  fit  within  the  normal  classroom  routines. 

HOW  SHOULD  OBSERVATIONS  BE  DONE? 

There  are  many  approaches  to  carrying  out  the  mechanics  of  the  actual 
observations. 

Note  Taking:  One  issue  relates  to  note  taking.  Notes  can  be  written  up  as  the 
observation  is  occurring  or  they  can  be  written  up  at  the  end  of  the  observation  period. 
Furthermore,  notes  can  be  detailed  or  global  with  the  content  being  objective  or 
subjective. 

While  there  is  no  single  right'  way  to  take  notes,  the  notes  should  be  specific 
enough  so  that  particular  incidents  or  activities  can  be  referred  to  as  planning  team 
members  sift  through  the  information  they  have  collected.  Notes  should  also  serve  as  a 
record  of  what  was  observed  so  that  the  observer  can  be  sure  that  with  the  arrival  of 
new  information  and  the  fading  of  one's  memory  the  information  obtained  from  the  ob- 
servations is  as  accurate  as  possible.  Sample  observation  forms  for  recording  observa- 
tion data  are  included  and  discussed  at  the  end  of  this  section. 

Observer's  Behavior.  Observers  should  seek  to  be  as  unobtrusive  as  possible. 
Thus,  when  in  classrooms  for  more  than  a  brief  look,  observers  should  position  them- 
selves at  the  back  of  the  classroom  or  some  other  point  where  they  are  out  of  direct 
view  of  the  students.  Furthermore,  observers  should  avoid  talking  among  themselves 
while  in  the  classroom.  If  the  observer  has  questions  for  the  teacher,  they  should  be 
held  until  after  the  observation  period  has  ended.  Any  conversations  which  students  or 
teachers  may  initiate  with  observers  should  be  kept  as  brief  as  is  politely  possible. 
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Observers'  respectfulness  of  the  teachers,  students,  and  other  members  of  the 
school  community  whom  they  observe  should  extend  beyond  the  immediate  observa- 
tion period.  It  includes  maintaining  confidentiality  appropriate  to  the  situation  and  not 
talking  about  the  observations  with  people  who  are  not  on  the  planning  team.  When 
discussing  your  observations  with  other  team  members,  you  should  be  sure  that  your 
conversation  is  private  and  that  it  reflects  a  spirit  of  constructive  collaboration  in  the 
service  of  the  overall  goal  of  school  improvement. 

WHO  SHOULD  DO  THE  OBSERVING? 

There  is  no  overall  rule  for  determining  who  should  do  the  observations.  How- 
ever, in  order  to  clearly  separate  the  process  from  personnel  evaluation,  it  would  be  ad- 
visable to  have  team  members  observe  peers  rather  than  subordinates.  Otherwise, 
talent,  interest,  and  availability  may  be  the  determining  factors. 

HOW  SHOULD  OBSERVATION  DATA  BE  SUMMARIZED? 

As  soon  as  possible  after  the  observation  has  been  completed,  observers  should 
review  their  notes  for  completeness  and  revise  them  as  necessary.  After  the  review  for 
completeness,  the  observer  should  review  his/her  notes  to  identify  common  themes 
and  unique  incidents  which  may  be  relevant  to  the  issues  targeted  for  change  and  to 
possible  recommendations  for  improvement.  Each  observation  should  be  summarized 
briefly  for  sharing  with  the  planning  team. 

WHAT  ARE  THE  SHORTCOMINGS  OF  OBSERVATIONS? 

1.  Limited  scope  may  compromise  reliability  and /or  validity. 

a.  Team  members  will  not  be  able  to  observe  many  classrooms  and  may  not  be 
able  to  observe  the  same  classroom  more  than  once.  Consequently,  what  they 
see  may  not  be  typical  of  what  usually  occurs  in  the  instructional  program  in 
the  school. 

b.  Many  important  things  may  occur  outside  of  the  observation  period  about 
which  the  observer  is  unaware. 

2.  The  observer  may  'miss'  important  details  and  or  events  due  to  inattention,  fa- 
tigue and/or  unsystematic  observing. 

3.  The  observer  may  focus  on  the  'wrong'  details  or  misinterpret  actions  due  to 
his/her  own  biases  and  assumptions. 

4.  The  observation  may  result  in  so  much  information  that  it  will  be  difficult  for  the 
tean\  to  analyze  all  of  it. 
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CONCLUSION 

As  an  information  gathering  tool,  observation  can  provide  data  w^hich  are  highly  useful. 
However,  it  is  time-consuming  and  can  lead  to  confusion  instead  of  clarification  unless  it  is 
v^^ell  planned  and  focused.  Belov^,  the  two  pages  of  a  "Sample  Form  for  Observation  Notes"  are 
shov^m.  Use  of  these  forms  may  make  the  observation  process  easier. 

How  Can  The  Form  For  Observation  Notes  Be  Used? 


The  first  page  allows  the  observer  to  record  information  about  the  context  of  the  ob- 
servation: 'what',  'who',  and  'where',  and  also  provides  a  section  for  the  observer  to  add  some 
notes  and  overall  impressions  after  the  observation  period  is  complete.  The  first  section  is  for 
recording  information  about  the  observational  setting,  i.e.,  school,  date  and  time,  the  observ- 
er(s),  and  descriptions  of  the  setting  and  the  participants.  The  second  section,  'Brief  Description 
of  the  General  Activity'  should  contain  information  about  the  activity  and  any  particularly 
noteworthy  events.  The  last  section,  'Post-Observation  Notes',  is  for  the  observer's  additions 
and  comments  after  the  observation  has  been  completed.  Where  the  comment  or  elaboration  is 
tied  to  a  particular  event,  that  should  be  indicated  in  the  note.  The  second  page  provides  a  way 
of  recording  observational  notes  in  specific  categories.  The  categories  used  should  be  ones 
which  have  been  planned  in  advance,  and  should  be  limited  in  nuniber. 

Figure  1 

Pages  1  and  2  of  Form  for  Observation  Notes 
(taken  from  Intervention  Team  Manual) 


Intervention  Team:  Sample  Form  for  Observation  Notes 


Time  of  observation, , 


Durabon  of  obwrvation  . 


Brt»r  OMO^Son  of  Participants 


aumf  Dttcfpoon  ot  fm  Gtmfwl  *£Wtnr 


Intervention  Team:  Sample  Form  for  Observation  Notes 


*  S«*ln(iTV«ntMXi  Training  Maixusl  imetujn.  Otacrwtg  for  \aM  ot n 
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Interviewing 


WHY  INTERVIEW? 


An  interview  is  a  focused  discussion  between  team  members  and  one  or  more 
members  of  the  school's  community.  An  interview  may  offer  the  best  opportunity  to 
learn  about  the  school  community's  view  of  the  issue  under  discussion.  Where  an  area 
has  been  targeted  for  improvement,  it  can  be  very  important  to  understand  the  ratio- 
nale for  existing  practices,  how  the  participants  feel  about  what  is  currently  happening, 
and  what  they  think  about  any  specific  changes  which  may  have  been  proposed.  In 
some  cases,  interviews  may  capture  data  that  surveys  could  miss.  In  other  instances,  in- 
terviewing could  be  used  prior  to  preparing  a  survey,  in  order  to  focus  the  issues  for  a 
survey  and  make  sure  nothing  crucial  is  left  out. 

For  team  members,  the  interview  gives  them  the  opportimity  not  only  to  ask 
questions  but  to  follow  up  on  the  answers.  Asking  additional  questions  enables  team 
members  to  get  clarification,  justification  and /or  additional  information  about  certain 
aspects  of  the  response. 

WHO  SHOULD  BE  INTERVIEWED? 

The  answer  to  this  question  of  course  depends  on  the  issues  chosen  for  particular 
attention.  Like  observing,  interviewing  is  time-consuming,  so  choices  should  be  made 
with  a  view  to  maximizing  the  potential  for  information  gained.  However,  some 
choices  are  obviously  dictated.  For  example,  if  integration  of  special  needs  and  regular 
education  students  is  a  thrust  of  the  Annual  Plan,  then  teachers  in  integrated  classrooms 
are  logical  candidates  for  interviews.  However,  one  might  also  want  to  interview  some 
parents  of  both  groups  of  students,  and  perhaps  students  themselves,  to  understand  the 
wider  impact  of  classroom  integration. 

It  might  be  most  efficient  to  interview  small  groups  of  people  (3  to  5).  These 
small  groups  should  be  composed  of  individuals  who  are  likely  to  have  a  similar  frame 
of  reference  vis-a-vis  the  area(s)  to  be  examined.  Thus,  for  the  example  of  special  needs 
integration,  it  might  be  best  to  interview  a  group  of  SPED  teachers  and  a  group  of  regu- 
lar education  teachers  separately  rather  than  two  groups  with  SPED  and  regular  educa- 
tion teachers  combined. 

WHEN  SHOULD  INTERVIEWS  BE  DONE? 

Interviewing  should  be  done  at  a  time  when  the  interviewee  is  not  likely  to  be  in- 
terrupted and  will  have  enough  time  to  take  part  in  the  interview  in  a  unhurried  man- 
ner. Scheduling  should  be  done  in  consultation  with  the  principal/headmaster. 
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WHERE  SHOULD  INTERVIEWS  BE  DONE? 

While  it  may  be  difficult  to  locate  appropriate  interviewing  space  in  some 
schools,  interviewers  should  keep  two  primary  considerations  in  mind  as  they  begin 
interviewing: 

1.  Is  the  interviewing  location  sufficiently  private  so  that  interviewees  will  feel  that 
they  can  speak  freely  without  others  overhearing  their  comments;  or  is  someone 
likely  to  barge  in  unannounced? 

2.  Is  the  interviewing  location  reasonably  quiet  and  comfortable? 

WHAT  QUESTIONS  SHOULD  BE  ASKED? 

Questions  should  be  designed  to  elicit  the  desired  information  in  as  efficient  a 
way  as  possible.  Since  the  time  available  for  an  interview  will  always  be  limited,  it  is 
particularly  important  that  interview  questions  be  prepared  in  advance.  Some  issues  to 
consider  as  the  interview  is  put  together  are  listed  below  (based  on  the  work  of  Egon 
Guba  and  Yvonna  Lincoln,  1981,  p.  177).  As  each  question  is  written,  team  members 
should  ask  themselves: 

1.  Is  the  question  necessary  and,  if  yes,  how  will  the  response  be  used? 

2.  Is  the  question  sufficient  to  cover  the  topic  or  are  additional  questions  needed? 

3.  How  will  the  question  be  interpreted  by  the  interviewee?  Different  people  may 
interpret  a  question  differently.  Thus  in  some  cases  additional  information  may 
be  needed  as  a  preface  to  the  question. 

4.  How  will  you  know  if  the  interviewee  misunderstood  the  question? 

5.  Will  the  interviewee  have  the  information  needed  to  answer  the  question 
adequately? 

6.  How  likely  is  it  that  the  answer  will  be  accurate?  Try  to  avoid  'leading'  questioris 
which  have  only  one  'socially  correct'  answer. 


WHO  SHOULD  DO  THE  INTERVIEWING? 

As  with  observations,  it  is  probably  less  threatening  to  members  of  the  school 
community  if  interviewers  do  not  have  a  supervisory  relationship  with  interviewees. 
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HOW  SHOULD  INTERVIEWS  BE  CONDUCTED? 

There  are  many  approaches  to  carrying  out  the  mechanics  of  actual  interviews.  It 
is  very  important  to  be  prepared  beforehand  both  in  terms  of  being  comfortable  with 
the  questions  and  in  knowing  about  the  people  to  be  interviewed. 

The  time  constraints  of  the  school  day  will  limit  the  length  of  the  interviews;  in 
general,  individual  interviews  should  be  no  longer  than  one  half  hour,  and  group  inter- 
views should  be  kept  to  an  hour  or  so. 

Making  the  Interviewees  Comfortable:  Some  interviewees  may  be  uncomfort- 
able with  being  interviewed,  although  this  should  be  less  of  an  issue  in  a  group  inter- 
view setting.  Team  members  should  try  to  help  the  interviewees  to  feel  comfortable 
and  to  complete  the  interview  feeling  good  about  the  process  and  satisfied  that  they 
have  made  a  contribution  toward  their  school's  improvement.  While  teachers  and  other 
school  personnel  should  accommodate  their  colleagues  who  are  working  on  implement- 
ing the  Annual  Plan  whenever  possible,  team  members  should  also  respect  teachers' 
and  students'  privacy  and  bear  in  mind  that  interviewees  may  not  feel  comfortable  dis- 
cussing certain  issues. 

Note  Taking:  One  issue  relates  to  note  taking.  Notes  should  be  written  up  as 
the  interview  is  occurring.  You  may  even  consider  using  a  tape  recorder,  but  should  do 
so  orily  with  the  permission  of  the  interviewee(s)  and  only  as  a  backup  for  your  notes. 
Try  to  take  detailed  notes  that  include  the  key  words  and  phrases  used  by  the  inter- 
viewee. If  it  is  a  group  interview,  be  sure  to  indicate  clearly  who  made  each  comment. 

Interviewer's  Behavior:  Interviewers  should  seek  to  be  neutral  yet  friendly.  Af- 
ter a  question  has  been  asked,  the  person  should  have  sufficient  time  to  think  about  a 
response  and  to  make  their  comment.  If  the  interviewer  is  not  sure  about  what  the  in- 
terviewee said,  he/she  should  ask  for  clarification  or  rephrase  the  response  and  ask  if 
that  was  what  the  interviewee  meant.  However,  the  interviewer  should  avoid  'answer- 
ing questions  for  them'  or  'putting  words  in  their  mouth'.  If  a  group  interview  is  con- 
ducted, the  interviewer  needs  to  be  skilled  at  both  keeping  the  discussion  going  and 
giving  each  participant  a  chance  to  be  heard. 

Interviewers  will  be  interviewing  members  of  their  own  school  community. 
Therefore,  issues  of  confidentiality  and  respectfulness  are  particularly  important.  When 
discussing  your  interviews  with  other  planning  team  members,  you  should  be  sure  that 
your  conversation  is  private.  Even  if  you  don't  like  something  you  heard,  you  should 
discuss  the  content  as  objectively  as  possible,  perhaps  noting  at  the  end  of  your  written 
interview  summary  why  you  disagreed  with  what  you  heard. 
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HOW  SHOULD  INTTERVIEW  DATA  BE  SUMMARIZED? 

As  soon  as  possible  after  the  interview  has  been  completed,  interviewers  should 
review  their  notes  for  completeness  and  revise  them  as  necessary.  After  the  first  re- 
view, the  notes  should  be  reviewed  again  in  order  to  identify  common  themes  and 
unique  comments  which  may  be  relevant  to  the  elements  of  the  Annual  Plan  which  are 
the  focus  of  the  interview.  Each  team  member  should  prepare  a  brief  summary  of  their 
notes  which  includes  specific  examples  of  relevant  themes  and  comments.  The  summa- 
ry should  also  be  made  available  to  other  members  of  the  team  for  their  review. 

WHAT  ARE  THE  SHORTCOMINGS  OF  INTERVIEWS? 

As  with  any  data  collection  tool,  interviewing  has  its  limitations.  By  keeping 
these  limitations  in  m.ind,  team  members  can  avoid  the  potential  mistake  of  relying  too 
heavily  on  interview  data  to  the  exclusion  of  information  from  other  sources.  The  most 
serious  limitations  of  interviewing  are: 

1.  Those  who  are  interviewed  may  not  always  be  the  "best"  or  the  most  articulate 
informants.  One  strategy  to  address  this  problem  would  be  to  invite  members  of 
the  school  community  who  are  not  interviewed  to  submit  written  comments. 

2.  The  team  may  not  ask  the  'right'  questions.  Careful  planning  and  trying  out  the 
questions  with  others  before  the  interviewing  begiiis  is  the  best  strategy  for  mak- 
ing sure  that  the  key  questions  are  asked.  In  addition,  it  may  be  necessary  to  re- 
fine, add,  or  discard  questions  as  the  interviewing  process  proceeds  if  team 
members  find  that  certain  questions  are  not  working  the  way  they  had  expected 
them  to  work. 

3.  The  interviewee's  answers  may  be  incomplete  or  inaccurate  or  may  be  misunder- 
stood by  the  team  members.  To  minimize  this  problem,  it  may  be  necessary  in 
som  cases  to  recontact  an  interviewee  to  get  additional  clarification  of  something 
that  was  said.  At  the  point  of  data  interpretation,  if  only  one  person  makes  a 
particularly  crucial  comment,  it  would  be  wise  to  try  to  verify  the  information 
from  a  second  source. 


CONCLUSION 

Interviewing  is  a  powerful  and  useful  data  collection  tool,  but  its  utility  is  direct- 
ly related  to  the  planning  done  by  the  team  before  interviewing  begins  and  the  care 
with  which  the  data  are  summarized  and  interpreted.  Below  is  a  form,  the  'Interview 
Data  Collection  Form',  offered  as  an  example  to  assist  planning  teams  with  the  inter- 
view process. 
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How  Can  the  Interview  Data  Collection  Form  Be  Used? 

The  interview  data  collection  form  has  five  basic  sections  on  two  pages.  The  first 
section  is  to  record  information  about  the  interview  context,  i.e.  school,  date  and  time, 
and  the  interviewer(s).  The  second  block  is  for  keeping  track  of  who  was  interviewed 
and  relevant  information  about  their  role  in  the  school.  The  third  through  fifth  sections 
are  where  the  actual  interview  content  is  recorded.  The  third  section,  'Preplanned  Ques- 
tion/Probe' should  be  prepared  before  the  interview  begins.  The  purpose  of  this  sec- 
tion is  to  focus  the  interview  beforehand.  The  fourth  section,  'Response',  is  where  the 
actual  notes  from  the  interview  should  go.  In  group  interviews,  the  notes  should  also 
specify  the  person  who  made  specific  comments.  The  last  section,  'Post-Interview 
Notes',  is  for  the  interviewer's  additions  and  comments  after  the  interview  has  been 
completed.  Where  the  comment  or  elaboration  is  tied  to  a  particular  response,  that 
should  be  indicated  in  the  note. 

Figure  2 

Interview  Data  Collection  Forni 
(taken  from  Intervention  Team  Manual) 

Pages  1  and  2 


Interview  Data  Collection  Form 


Record  of  Peopto  Interviewed 

Interview  Data  Collection  Form 


Interviewees): , 
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im'RODUCriON  AND  OVERVIEW 

Why  Assess  Attitudes? 

Whiie  most  school  objectives  are  focused  on  cognitive  outcomes,  many  will  often  seek  to 
affect  student  feelmgs,  beliefs  and  values.  When  this  is  the  case  there  will  be  a  need,  just  as 
with  student  achievement,  to  find  measures  that  can  credibly  assess  either  changes  in  or  the  stanjs 
of  student  attitudes.  However,  even  when  attitudes  are  not  the  expressed  aim  of  a  program, 
schools  will  be  concerned  with  the  impact  of  school  programs,  activities  or  simply  the  total 
school  environment  on  how  students  feel  about  themselves,  their  teachers,  their  classmates  and 
their  school.  When  this  is  the  case  the  collection  of  attitudinal  information  can  be  important  in 
encouraging  staff  (as  well  as  student)  dialogue  about  program  impact  as  well  as  bringing  about 
program  changes.  In  short,  all  programs  affect  attitudes.  Finding  out  how  these  are  being 
affected  can  be  important  in  directing  school  efforts  towards  improving  student  learning 
opportunities. 

How  Measures  Were  Selected 

Technical  and  practical  cntena  guided  the  selection  of  measures  to  include  in  this  Guide. 
Published  reviews,  where  available,  were  examined  as  well  as  information  provided  by  the 
instrument  publishers  themselves  to  insure  that  each  measure  was  technically  acceptable  and 
appropriate  for  use  in  school  settings.  Practical  cntena  included  ease  erf"  administration  (  all  can  be 
administered  by  teachers  in  classroom  settings),  minimal  ame  demands  (  all  are  unomed  and  do 
not  usually  exceed  30  minutes  to  administer),  reasonable  pricing,  ready  avallabihty,  capability'  of 
being  hand-scored  ( those  requinng  computer  sconng  or  sconng  by  the  publisher  are,  for  the 
most  part,  not  included)  and  recency  of  publication  (  most  measures  were  developed  after  1970). 

Organization  of  Guide      

The  Guide  is  organized  into  three  separate  sections.  The  first  contains  measures  of 
student  self-concept;  instruments  focused  on  student  attitudes  towards  self  (e.g  self  esteem,self 
confidence,etc).  The  second  section  contains  measures  of  student  atntudes  towards  school; 
instruments  pnmarily  focused  on  student  attitudes  towards  school  subjects,  teachers,  classmates, 
learning  and  the  schod  environment  The  third  section  contains  measures  of  teacher  and  parent 
(someumes  combined  with  student)  attitudes  towards  and  perceptions  of  school  and  school - 
related  concems.These  instruments  pnmanly  focus  on  speafic  condiuons  and/or  processes 
associated  with  effective  school  or  school  climate  research.  Following  the  last  section  is  a 
bibliography  of  informaaon  sources  for  readers  who  want  to  obtain  further  descnpove  or  cnDcaJ 
information  cxi  the  instruments  listed  m  this  Guide. 

The  information  provided  for  each  measure  includes  the  title,  author  and  year  of 
publication,  overall  purpose  of  the  measure  and  the  specific  areas  (attitudes,  factors, 
perceptions,etc)  that  each  measure  assesses.  This  is  followed  by  the  grade(s)  for  which  the 
measure  is  intended,  the  length  (number  of  test  items)  and  Qme  (when  available)  it  takes  on  the 
average  to  administer  tiie  measure  (all  are  unDmed)  and  how  each  measure  can  be  scored  (almost 
all  can  be  hand  scored).  The  last  three  items  include  the  name,address  and  phone  of  the 
publisher,  the  latest  cost  information  (this  always  needs  to  be  verified  as  pnce  changes  occur 
penodically)  and,  finally,  comments  about  the  measure  which  may  include  information  about 
technical  reviews,  norms  or  uiuque  charactenstics. 


.  How  to  Use  This  Guide 

The  puqx)se  of  the  Guide  is  to  provide  basic  information  on  a  range  of  instruments 
potentially  useful  to  schools.  As  such,  it  can  offer  general  guidance  in  making  some  preliminary 
selections  of  instruments  to  examine  further.  However,  the  informaDon  provided  is  limited  and 
should  not  be  a  substitute  for  (a)  reviewing  the  instruments  and  related  matenals  themselves,  (b) 
examining  published  reviews  (ated  in  the  Guide)  and/or  (c)  discussing  these  instruments  with 
staff  members  in  the  Office  of  Research  and  Dev  elopmenL  Not  only  will  the  staff  discuss  these 
instruments  with  you  but,  in  addition,  they  will,  m  many  cases,  have  addiUonal  information  on 
these  instruments  and/or  have  cc^ies  of  the  instruments  available  for  examination.  Contact  Ms. 
Mildred  Asano  at  the  Office  (638-9446)  for  further  mfonnanon. 


MEASURES  OF  STUDENT  SELF  CONCEPT 

Insooiments  focused  on  student  attitudes  towards  self  (e.g.  self  esteem  self 
confidence,  self  perception,  etc).  All  are  paper  and  penal,1onie  are  self  report 
measures  and  others  teacher  rating  scales.. 


Title 

Author/Year 

Purpose: 

Areas  Assessed 

Grades: 

Length/Timing: 

Scoring: 

Publisher 

Cost 
Comments: 


The  Self  Perception  Inventory  (SPI) 

Anthony  T.  Soares  and  Louise  M.  Scares- 1980 

Assesses  student  perception  of  self  and  perception  of  student  by  othere 

Individual  self  concept  and  perception  of  classmates  and  teachers 

1-12 

5-10  minutes 
Hand  scoring 

Td^  3^^'  ^  ^  ^  "^"^^  ^°^^  ^°^  TrumbelKCr  061 1 1 
Specimen  Set  $14.00 

^^"'^J!?  i"  ^^^  Meaurements  Yearbook  (9th  Edition)  Norms 
provided.  Available  in  Spanish  c^u^u-  iNorms 


Title 

AuthcxTYear 

Purpose: 

Areas  Assessed 

Grades: 

LengthTimmg 

Scoring: 

Publisher 


Cost 
Conments: 


Behavioral  Academic  Self  Esteem 

Stanley  Coopersmith  and  Ragnar  GUberts- 1981 

Measures  academic  self  esteem 

Student  iniaative,  social  attenuon,  succes^failure,  and  self^x^nfidence. 
PreK-8 

16  items  5  minutes 

Hand  key  (Teacher  rating  scale) 

Consulung  Psychologists  Press,  Inc.,  577  College  Avenue  P  O  Box 
60070,  F^o  Alto,  CA  9430^  Tel:  (415)  857- 1444 

Rating  scales  (25)  $6.00;  Manual-  $9.00 


Tide 

Author/Year 

Purpose: 

Areas  Assessed 

Grades: 

Length/Timing 

Scoring: 

Publisher 

Cost 
Comments: 


Self  Concept  and  Motivation  Inventory -Eariy  Education 
Norman  J.  Michus,  George  A.  Fanah,  William  Reitz 
Measures  student  self  concept  and  motivation 

1-3 

24  items/25  minutes 

Hand  key  or  computer  scored 

Person-O-Metncsjnc,  Evaluation  &  Development  Services  205M 
Wilbamsburg  Road,  Deaibom  Heights,  MI  48127 

Speamen  Set-$7.00;  Manual  $1.25,  Key  $4.00 

Available  also  for  grades  3-6  (48  items80  minutes)  and  7- 12  (^  items/ 
30-40  minutes). 


Title 

Author/Year 
Purpose: 
Areas  Assessed 

Grades: 

Length/Timing: 
Soonng: 
Publisher 

Cost 


Self  Concept  Scale 
Robert  Pfercival- 1982 
Assesses  Student  Self  Concept 

Deasionmakmg  skills,  interpersonal  relations,  responsibility 
study  skills  and  career  planning. 

7-12 

Not  available 

Hand  key  (Can  also  be  machine  scored) 

5S£^  S"^°"^  Services,  PO.  Box  83 1254,  Richardson,  Texas 
75083-1254  Tel.  (214)  234-^17 

Complete  Kit  (Manual,  35  pupil  record  forms/profile  sheets)  $3580 


Tide 

Coopersmith  Sdf  Esteem  inventory 

AuthovYear 

Stanley  Cnnpersmith  -  1981 

Purpose: 

Pereonal  evaluation  d"  self 

Areas  Assessed 

Assesses  general  self,  social  self-peers,  home-parents,  school -academic, 
and  total  self. 

Grades: 

Ages  8  to  15. 

Length/Timing: 

58  items/ 10  minutes 

Scoring: 

Hand  sconng  (Can  be  computer  scored,  scc»ing  services  available) 

Publisher 

Consulting  Psychologists  Press,  577  College  Avenue,  Palso  Alto,  CA 
94306.  Tel:  (415)857-1444 

Cost 

25  instruments-$7.00 

Comments: 

Reviewed  in  Test  Cntiques  (VcJ.  1)  and  N4ental  Measuremaits  Yearbook 
(9th  Edition).  Short  form  also  available. 

Tide: 

Self  Fsteem  Questionnaire 

AudxrA'ear 

James  K.  Hoffmeister 

Purpose: 

Assesses  individual  student  feelings  about  various  aspects  of  self 

Areas  Assessed" 

Self-esteem/  self-other  satisfactioa 

Grades: 

4  and  above 

LaigtfVTiming: 

21  items/ 15  minutes 

Soonng: 

Computer  sccxing  service. 

Publisher 

Test  Analyses  and  Development  Corporation,  2400  F^ric  Lane  Drive, 
Boulder,  Colorado  80-301  Tel:  (303)-666-8651 

Cost 

50  instruments  and  sconng  serv  ices-$50 

Comments: 

Reviewed  in  Test  Cntiques  (Vol  1 1) 
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MEASURES  OF  STUDENT  ATTITUDES 
TOWARDS  SCHOOL 


Instruments  are  pnmanlv  school  onented  and  focused  on  student  attitudes 
towards  school  subjects,  schoolmates,  teacherejeaming,  school  environment 
and/or  education  in  general 


Tide 

Author/Year 
Purpose; 
Areas  Assessed 

Grades: 

Laigth/Timing 
Scoring: 
F^iblisher 

Cost 
Comments: 


Tide: 

AuthcxA'ear 

Purpose: 

Areas  Assessed 

Grades: 

LengthATiming 

Scoring: 

Publisher 

Cost 
Commaits: 


Thinking  About  My  School 

Joanne  R.  Whitmore  -  1985 

Measures  student's  attitudes  and  opinions  about  their  school  environment 

(a)  peer  reladons/cullure,  (b)  teachers/administrators,  (c)  class  work  (d) 
pamapation  in  deasion  making  and  (c)  general  feelings  about  school: 

4-6 

47  items/  30  minutes  (additional  15  minutes  for  practice  allowed) 

Scoring  sheets  provided.  Hand  scored. 

United  Educational  Publishers,  Inc,  P.O.  Box  605,  East  Aurora, 
N.Y..  14052  Tel.  800458-7900 

Ccmp^ete  kit  ( 25  student  questionnaire/sconng  sheets/manual)-$22.00 

Reviewed  in  Mental  Measurements  Yeaitxx)k  ( 10th  Edition).  Calls  for 
response  statements  to  be  read  to  students. 


Ariai-Hills  Attitude  Survey 

Marshall  Arim  and  David  Hills- 1976 

Assesses  student  school  attitudes 

Attitudes  towaids  teachers,  learning,  language,  mathemaucs 

K-3, 4-6, 7-12 

60  items/20-40  minutes 

ComputCT  or  hand  scored 

Psychologists  and  Educators.  Inc.,  P.O.  Box  513,  Chesterfield  MO 
63006- Tel.  (314)  53^2366 

Specimen  Set-  $9.00  each  for  primary,  elementary  or  secondary  editions 
Combine  verbal  and  cartoon  format 
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Tide 

Attitudes  Towards  Scliool  Questionnaire  (ASQ) 

Author/Year 

G.P.  Stnckland,  R.  Hoepfnerand  S.P  Klein 

Purpose: 

Assesses  children's  attimdes  toward  school 

Areas  Assessed 

Attitudes  towards  schoolworic,  activities,  reading, 
playing. 

Grades: 

K-3 

Length/Timing 

15  itenis/20  minutes 

Scoring: 

HandKev 

Publisher 

Monitor,  P.O.  Box  2337.  Hollywood,  CA  90028 

Cose 

Speamen  Set- $10.00 

Comments: 

Uses  cartocxi  fomiat  (faces)  for  student  responses. 

CnQques  (Vol  V).  Norms  provided. 


Tide 

Authcx/Year 

Purpose: 

Areas  Assessed 

Grades: 

Length/Timing: 
Scoring: 
Pubbsher 

Cost 
Comments: 


Comprdiensive  Program:  School  Attitude  Measure 

Lawrence  J.  Dolan  and  Marci  M  Enos 

Evaluates  students'  views  of  their  academic  environment  and  selves  as 
competait  learners. 

School  motivation,  self-concept,  academic  self-concept,  sense  of  control 
and  sense  of  instructional  mastery. 

4-6,7-8.9-12 

Not  available 

Comfxiter  scored 

American  Testronics,  8600  W.  Brvn  MawT,  Chicago,  111  6063 1 
Td:  800-553-0030 

5  student  booklets-$30.00;  35  answer  sheets  $  10.80;  manual  $8.75 

Available  in  Spanish. 
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Tide 

Author/Year 
Purpose: 
Areas  Assessed 

Grades: 
Length/Timing: 
Soonng: 
Publisher 

Cost 

Comments: 


Quality  of  School  Life  Scale  (QSL) 

Joyce  L  Epstein  and  James  M.  McI^rtland-1976 

Assesses  student  feeling  about  school  environment 

(a)  Satisfaction  with  School;  (b)  Reaction  to  Teachers  and  (c)  Commitment 
loaassWoric 

4-12 

27  items/20  minutes 

Hand  scored 

Riverside  Publishing  Company ,8420  Brvn  Mawr  Ave,  ChicagoJU 
60631    Tel:  800-323-9540 

Speamen  Set  $  6.60;  Complete  Kit  (35  questionnaires/Manual/Sconng 
Key)-  $2120 

Reviewed  m  Mental  Measurements  Yearbook  (9th  Edition)  Norms 
provided 


Title 

Author/Year 
Purpose: 
Areas  Assessed 

Grades: 
Laigth/Timing 
Sccxing: 
Pul±sher 

Cost 
Comments: 


Student  OpinicHi  Inventory 

NatiCHial  Study  of  School  Evaluation- 1988 

Assesses  student  morale  and  attitude  toward  aspects  of  school  program 

(a)  Student  relationships;  (b)  school  programs;  (c)  student  partiapaDon 
and  (d)  student  satisfaction  with  school 

4-12 

46  items/45  minutes 

Hand  sconng.  Can  be  computer  scored. 

Naticmal  Studv  of  School  Evaluation,  5201  Leesburg  Pike,  Falls  Church, 
VI  22mi  -  Tel:  (703)  820-2728 

Complete  Kit  (50  copies  and  manual)  $14.00 

Companion  instruments  include  Teacher  Opinion  Inventory  and  Parent 
Opinion  Inventory.  Reviewed  in  Test  Cnnques  (Vol  VII) 
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Title 

Author/Year 

Purpose: 

Areas  Assessed 

Grades: 

Length/Timing: 

Seeding: 

Publisher 

Cost 
Comments: 


Student  Evaluauon  Scale  (SES) 

William  T.  Martin  and  Sue  Martin 

Assesses  attitudes  and  behavicH-  of  students 

Educational  response/Soaal-emoDonal  response 

Ages  6-21 

52  item/  5  minutes  per  student 

Rater  scon  ng 

Psychologists  and  Educators,  Inc.,  P.O.  Box  513,  Chesterfield,  MO 
63006  -  Tel:  (3 14)  -  536-2366 

Specimen  Set  (including  manual)-$9.00 

A  teacher/counsellor  checklist. 


Title 

Author/Year 
Purpose: 
Areas  Assessed 

Grades: 

Length/Timing 
SccMing: 
Pu  Wisher 

Cost 

Comments: 


Classroom  Environment  Scale  (2nd  Edition) 

Rudolf  H.  Moos  and  Edison  J.  Tnckett  -  1987 

Assesses  student  perception  of  junior/senior  high  learning  environment 

Assesses  student  involvementaffUiation  and  competition;  teacher  supipon 
and  control;  rule  clant>',  task  onentation,  order  and  organization  aiid 
innovatic«i. 

7-12 

90  item  long  fomi/20f  minutes 

Handsconng 

Consulting  Psychologists  Press,  577  College  Avenue,  Palo  Alto,  CA 
94306.  Tel:  (415)857-1444 

Speamen  Set-  $15.0OComplete  Kit  ( 25  tests/50  answer  sheets/profiles, 
sconng  key  and  manual)  -  $26.50 

Reviewed  in  Mental  Measurements  Yearbook  (10th  Edition)  and  Test 
Cntiques  ( Vd.  VI).  Comes  also  m  36  item  short  form.  Also  opDonal 
teacher  form.  Norms  pro\'ided. 


B 


Tide: 

Authorrifear 

Purpose: 

Areas  Assessed 

Grades: 

Loigth/Tinung 

Scoring: 

PuHisher 

Cost 
Commaits: 


Survey  of  School  Attitudes 

Thomas  P.  Hogan-  1975 

Assesses  student  attitudes  toward  major  curriculum  areas 

Reading/language  arts,  math,  saence  and  soaal  studies 

1-3  and  4-8 

60  items30-40  minutes 

Hand  scoring  (Scoring  services  available) 

ftychological  Corporation,  Harcourt  Brace  Jovanovichjnc,  555 
Academic  Court,  San  Antonio,  Texas  78204-2498  Tel:  800-22&O752 

Specimen  Set  $15.00 

Reviewed  in  Test  Critiques  (Vd.  1 1 1).  Norms  provided. 
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MEASURES  OFTEACHER/PARENT/STUDENT 
AITITUDES  TOWARD  SCHOOL 

specific  condiDons  and/or  processes  growing  out  of  resean:h  on  efiSS^ihocSr 
typically  assoaated  with  the  term  "school  climate. " 
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Tide: 

Author/Year 
Purpose: 
Areas  Assessed 


Grades: 
Laigth/riming 

Sconng: 
Publishen 

Cost 
Comments: 

Tide 

AuthorA'ear 
Purpose: 
Areas  Assessed 

Grades: 
Length/Timing: 

Scoring: 
Publisher 

Cost 
Comments: 


Effective  School  Battery  (ESB) 

Gary  D.  Gottfredson  -  1984 

Assesses  school  environment  and  strengths  and  weaknesses 

Student  measures  include  safetyjiespect  for  students,  planning  and  action 

^or^n  "^^  '"^"^  '"""^"^-  "^^her  measuLTduTSf^r' 
staff  morale,  planning  and  acuon.  smooth  administration  resources 

mn.;.^^S^"'^r'''^°"''  P^ntal/community  mvdv'ement,  student 
inlluence  and  use  of  grades  as  a  sanction 

7-12 

/t^S'"'  ^  ^  ^^  "^^^  '''"^'  ^  """""^  ^"^"^^'^^  -^  "^""^ 

Sconng  service  only  (score  and  interpretive  reports) 

ftychological  Assessment  Resources,  Inc  PO  Box  998  Orie«i« 
Ronda  33556  Tel:  8 13-968-3003  or  800-33 1 -TeIt  ^^ 

S^ThllSi 'P?^'  ^"^P*!^  Kit-(Manuals,  .nstnictions,50  student/25 
SJIrs^/^tScSl^'""^-'^-^    Sa.nngSe.ice-l^per'^ 

Reviewed  in  Moiial  Measurement  Yeartxwk  ( 10th  edition)  School 
profile  repons  show  school  dimate  separately  for  studeS^^aS^het^. 


Instructional  Climate  Inventory 

Larry  A.  Braskamp  and  Maitm  L  Maehr  - 1988 
Assesses  school  culture 

srrs  st«  ""^■"^^'^'™^"^'«=^'">-  p°"- 

3  and  above 

m^t2/°™"^~^  '^"^^  10minutes),Teacher  fomi-(  108  ,tems30 

Computer  scoring 

^^^'i"i:^^-l^  "^  ^P-^n  6182C.TeK217, 

Not  available 

JArS989'^''^'^  m  MoQvation  and  Achievement  Vol  6,  (24^277) 
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Title 

AuthorAfear 
Purpose: 
Areas  Assessed 

Grades: 

Length/Timing 
Socwing: 
Publisher 

Cost 
Commaits: 


Parent  Opinjon  In\'entory 

National  Study  of  School  Evaluation  -  1S88 

Evaluates  parent  opinions  of  their  children's  school  and  ,ts  programs 

General  psychological  climate;  school  programs  support  and 

K-12 

38  items 

Compute  or  hand  scored 

Complete  Kit  ( 25  copies  and  administration  manual)  $10.00 
Reviewed  in  Test  Cntiques  (Vol.  VI 1) 


Title 

Author/Year 
Purpose: 
Areas  Assessed 

Grades: 

Length/Timmg 
Scoring: 
Publisher 

Cost 
Ccmments: 


Teacher  C^on  Inventory 

National  Study  of  School  Evaluation  -  1 988 

Evaluates  teacher  opinion  towand  several  facets  of  school  operations 

Organization  and  Administration,  Curriculum  and  Instruction  Student 
Disaphnei  Counseling,  School  Community- RelaSl^SSb^^Son 
K-12 

73  items  (self  administered) 
Computer  and  hand  sconng 

vr^,'Yei;?7t;S,f^"^"°"-^^°' ^^8  «te.  Falls  Church, 

25  copies  and  manual-$I0.00 
Reviewed  in  Test  Cntiques  (Vd.  VII) 
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Title 

Author/Year 
Purpose: 
Areas  Assessed 

Grades: 
Length/Timing 
Soonng: 
Publisher 

Cost 
Commaits: 


Puidue  Teacher  Opinionaj  re 

Ralph  R  Bentley  and  Anemx)  Rempel/ 1980 

Assesses  teacher  morale 

t^^f  T^^'  "^^  "^'^  P^"^^  ^^  cdlegues,  satisfact]on,  load 

7-12 

100  items^O-30  minutes 

Qxnputer  or  hand  scored 

pstnbuted  by  Ralph  R.  BenUey,  2741  N.Salisbun'St32P  West 
Ufayette,  IN  47906.  Copynght  held  by  Puixlue  R^seairh  RxmSon. 

Not  available 

mrS2^  ^"'"""^  "^'''"^  m  1961,  the  instoiment  was  revised 


Title 

Author/Yean 
Purpose: 
Areas  Assessed 

Grades: 

Laigth/Timing: 
Scoring: 
Publisher 

Cost 
Comments: 


Qass  Activities  Questionnaire  (CAQ) 

Joe.  M  Steele  -  1982 

Assesses  instructional  cognitive  and  affective  classroom  climate 

Assesses  higher  and  lower  thought  processes,  classroom  focus 
^^^'^'^^^^^^)'dassroom  climate  (enthusiasm  jdeas 
valued4ndependence,divergence,etc)  and  student  opinions. 

6  and  above 

30  items/20-30  minutes  (student  and  teacher  fomis) 
Computer  or  hand  scored 

(i'^72M2S"^  ^'^'  ^"^  ^'^'  ''^^'^'^'  ^^'  CT  06250  -  Tel: 

Speamen  Set-$8.95  /  Complete  Kit  (30  students)  $22.95 
Reviewed  in  Test  Cntiques  (Vd.  VII) 
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Title 

AuthayVear 

Purpose: 

Areas  Assessed 

Grades: 

Length/Timing: 

SocMing; 

Publisher 

Cost 

Commaits: 


Tide 

Autfxr/Year 
Purpose: 
Areas  Assessed 

Grades: 
Length/Timing: 

Scoring: 
Publisher 


Comprehensive  Assessment  of  School  Environments 
Edgar  Kelley- 1967 

A^^  perceptions  of  students.teachers  and  parents  about  school 

J^^^^'^J^^^^^oo]  and  community  relationships,  administra- 
tia^secunty  and  maintenance,  guidance,  instKictional  maSgemenT^ 
student  academic  onentation,  activities  and  behavioral  valu^ 

7-12 

SSitans 

MicroocMnputCT  and  commerciai  scoring 

NASSP,  PO  Box  3250,  Reston.  VI  22090-1250 

Specimen  Set-$  10.00 

Oimate  suivey  can  be  supplemented  with  teacher.parent,  and  student 
satisfaction  surveys-Norms  provided. . 


Dimensions  of  Excellence  Scales 

Russell  A.  Dusewicz  and  Franane  S.  Beyer  - 1990 

Assesses  the  quality  and  effectiveness  of  a  school 

School  climateJeadeRhip,teacher  behavior,  cumculum,  monitonng  and 
assessment,  student  disaplme,  staff  development  and  parent  involvement 

4-12 

Staff  (200  Items/45  minutes).  Parent  (71  itenW30  minutes) 
Stiident  (44  items/30  minutes) 

Hand  scored  or  publisher  sconng  service 

j^^ea^ch  for  Better  Schools,  444  North  Thini  Stieet,  Phil,  PA  19123 


Cost 
Comments: 


Speamen  Set-  $4.75 

No  reviews  because  of  recent  puWicaDon.  Good  reliability  for  staff 
instnimenL  No  validity  data  No  technical  data  on  parent  or  student 
lasuuments. 
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Appendix  A:  Surveys 


SURVEYS 


Middle  School 

1 .  Parents:    A  Survey  About  My  Child's  School  --  1993-1994    (Domain  Set  A)  (2  pages)* 

2.  Parents:    A  Survey  About  My  Child's  School  --  1993-1994    (Domain  Set  B)  (2  pages) 

3.  Faculty:    Middle  School  Faculty  Survey  ~  1993-1994    (3  pages) 

4.  Students:  A  Survey  of  Opinions  for  Middle  School  Students  (4  pages) 

Elementarv  School 

5.  Parents:    A  Survey  About  My  Child's  School  -  1993-1994    (Domain  Set  B)  (2  pages) 

6.  Faculty:    Elementary  School  Faculty  Survey  -  1993-1994  (3  pages) 

7.  Students:  We'd  Like  to  Hear  From  You...     (1  page) 


*       This  survey  (Domain  Set  A)  is  the  same  for  both  elementary  and  middle  school  parents 


Appendix  A:  Surveys 


Middle    School 
Parents:      A  Survey  About   My  Child's   School   -- 
1993-1994        (Domain    Set    A) 


A  SURVEY  ABOUT  MY  CHILD'S  SCHOOL  -  1993-1994 


For  how  many  years  have  you  enrolled  your  child(ren)  in  our  school? 


Grade  of  oldest  child  in  our  school: 


Dear  Parent/Guardian: 

We  want  to  know  how  we  are  doing.  Please  tell  us 
how  satisfied  you  are  with  our  efforts  regarding  the 
areas  listed  below.  Please  circle  your  response  for 
each  item  using  the  scale  shown  on  the  right. 


SCALE:  4  =  Very  satisfied 
3  =  Satisfied 

2  =  Dissatisfied 

1  =  Very  dissatisfied 

0  =  1  don't  know 


My  child's  school... 

A.  Voice  in  School  Governance 

1 .  asks  for  my  input  about  setting  goals  and  program  priorities  for  the  school. 

2.  asks  me  for  suggestions  about  school  rules  and  policies  that  affect  my  child. 

3.  makes  effective  use  of  parents'  skills,  abilities  and  talents. 

4.  reaches  decisions  on  a  consensus  or  participatory  basis. 

B.  Resources 

1 .  has  sufficient  funds  to  purchase  needed  supplies,  materials,  and  equipment. 

2.  has  supplies  and  materials  to  support  the  instructional  program. 

3.  has  computer  hardware  and  software  programs  to  teach  computer  literacy. 

4.  has  a  media  center  or  library  to  support  the  instructional  program. 

5.  uses  community  agencies  (e.g.,  health,  medical  or  legal  services)  to  help  children. 

C.  Networking 

1 .  calls  upon  its  partnerships  (e.g.,  business,  college,  museums)  for  help  as  needed. 

2.  asks  me  to  serve  on  one  or  more  (parent)  committees. 

3.  has  the  students  and  faculty  participating  in  neighborhood  programs. 

4.  has  a  faculty  which  works  well  together  to  achieve  common  goals. 

5.  works  with  the  Parent  Information  Center  for  school  registration  and  other  activities. 

D.  Personal  and  Social  Development 

1 .  teaches  students  to  show  appreciation  and  gratitude  toward  others. 

2.  teaches  students  to  work  in  a  team  or  group  effort. 

3.  encourages  students'  creativity  and  special  talents. 

4.  encourages  acceptance  and  respect  for  oneself  and  others  in  students. 

5.  teaches  students  to  respect  or  value  raciaiyethnic,  language,  and  cultural  diversity. 

6.  inspires  in  students  the  desire  for  personal  growth. 

7.  instills  in  students  the  willingness  to  take  risks. 


4 
4 
4 
4 
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SCALE:      4  =  Very  satisfied      3  =  Satisfied  2  =  Dissatisfied  1  =  Very  dissatisfied  0  =  1  don't  know 


My  child's  school... 

E.  Student  Activities  and  Participation 

1 .  allows  students  to  have  a  voice  in  the  types  of  activities  offered  in  the  school. 

2.  has  students  plan  their  own  extracurricular  activities. 

3.  allows  students  to  make  policies  for  governing  the  student  body. 

4.  offers  ALL  students  the  opportunity  to  participate  in  at  least  one  extracurricular 
activity. 


SCALE 
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F.  Parent  Involvement 

1 .  keeps  me  abreast  of  the  school's  activities  and  accomplishments.  4 

2.  keeps  me  abreast  of  my  child's  progress  in  school.  4 

3.  notifies  me  about  workshops  for  parents  or  the  family  (e.g.,  parenting  skills,  literacy).  4 

4.  provides  me  with  suggestions/ideas  to  support  my  child  with  his/her  schoolwork.         4 
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G.  How  important  is  it  for  you  that  your  child's  school  focus  on  the  following  areas? 


Areas  Very  important 

1 .  Voice  in  Governance  

2.  Resources  

3.  Networking  

4.  Personal  &  Social  Dev.      

5.  Student  Activities  

6.  Parent  Involvement  


Quite  important  Somewhat  important 


Not  important  at  all 


H.  Overall  (Please  place  a  check  mark  in  front  of  the  word  which  best  summarizes  your  view.) 


1. 

My  child's  school  is...             outstanding 

excellent 

good 

fair 

poor 

2. 

Students  are...                          explorative 

interested 

attentive              bored 

disruptive 

How  actively  involved  ... 

3. 

are  parents  of  children  in  this  school? 

highly 

_  moderately 

minimally 

I  don't  know 

4. 

are  the  school's  business  partners? 

highlv 

_  moderately 

minimally 

I  don't  know 

5. 

are  the  school's  university/college  partners? 

highlv 

_  moderately 

minimally 

I  don't  know 

6. 

are  the  cultural  partners? 

highlv 

_  moderately 

minimally 

I  don't  know 

7. 

is  the  school's  neighborhood? 

highlv 

_  moderately 

minimally 

I  don't  know 

8. 

is  the  Parent  Information  Center? 

highly 

_  moderately 

minimally 

I  don't  know 

I.  Please  complete  the  following  sentences; 

1 .  When  I  walk  into  my  child's  school,  I  sense  the  school  is    ^ 


2.  The  faculty  and  other  personnel  in  the  school  are 
Other  comments  about  my  child's  school: 


Thank  you! 


Appendix  A:  Surveys 


Middle   School 
Parents:      A   Survey   About   My   Child's   School 
1993-1994        (Domain   Set    B) 


A  SURVEY  ABOUT  MY  CHILD'S  SCHOOL  --  1993-1994 


For  how  many  years  have  you  enrolled  your  child(ren)  in  our  school? 


Grade  of  oldest  child  in  our  school: 


Dear  Parent/Guardian: 

We  want  to  know  how  we  are  doing.  Please  tell  us 
how  satisfied  you  are  with  our  efforts  regarding  the 
areas  listed  below.  Please  circle  your  response  for  each 
item  using  the  scale  shown  on  the  right. 


SCALE:  4  =  Very  satisfied 
3  =  Satisfied 

2  =  Dissatisfied 

1  =  Very  dissatisfied 
0  =  1  don't  know 


My  child's  school... 

A.  Academic  Focus 

1.  offers  a  well  balanced  curriculum. 

2.  has  high  academic  expectations  for  all  children. 

3.  assigns  an  appropriate  amount  of  homework  to  students. 

4.  teaches  my  child  how  to  : 

a.  study  and  learn. 

b.  listen  and  speak  to  an  issue  at  hand. 

c.  conduct  research  or  solve  problems. 

d.  plan  and  make  inquiries. 

e.  analyze  and/or  evaluate. 

f.  reason  and  make  decisions. 

g.  cooperate  and  negotiate, 
h.  organize  and  govern. 

B.  Support  Services 

1 .  makes  sure  that  children  receive  the  appropriate  special  services  they  may  need. 

2.  offers  extracurricular  activities  to  accommodate  students'  abilities  and  interests. 

3.  has  teachers  who  tutor  students  on  an  individual  or  small  group  basis. 

4.  has  cross-grade  students  tutor  on  an  individual  or  small  group  basis. 

5.  provides  counseling  or  guidance  services  to  children. 

C.  Innovation  and  Change 

1 .  uses  various  sources  of  information  to  determine  student  performance. 

2.  is  changing  the  way  the  school  is  operated  and  is  managed. 

3.  places  my  child  in  a  classroom  where  students  have  different  levels  of  abilities. 

4.  has  begun  to  advertise  the  school  to  parents  who  are  not  familiar  with  the  school. 

D.  Parent  Involvement 

1 .  keeps  me  aware  of  the  school's  activities  and  accomplishments. 

2.  keeps  me  aware  of  my  child's  progress  in  school. 

3.  notifies  me  about  workshops  for  parents  or  the  family  (e.g.,  parenting  skills,  literacy).  4 

4.  provides  me  with  suggestions/ideas  to  support  my  child  with  his/her  school  work. 
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SCALE:      4  =  Very  satisfied  3  =  Satisfied         2  =  Dissatisfied  1  =  Very  dissatisfied  0  =  I  don't  know 


My  child's  school... 

E.    Facilities  and  Safety 

1 .  provides  a  safe  and  orderly  environment.  4 

2.  makes  sure  that  the  school  building(s),  classrooms,  and  grounds  are  well-maintained.    4 

3.  makes  sure  that  students'  and  faculty's  personal  property  is  safe  from  theft.  4 

4.  makes  sure  that  everyone  can  walk  about  freely  without  fear  of  physical  harm  4 
or  injury. 
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F.    Educational  Issues 

With  regard  to  your  child's  school,  to  what  extent  are  you  satisfied  with... 

1.  the  number  of  students  promoted  to  the  next  grade  level? 

2.  school  funding  and  its  impact  on  maintaining  the  same  staffing  pattern? 

3.  the  number  of  students  referred  for  discipline. 

4.  the  students'  performance  level  on  achievement  tests  such  as  the  Metropolitan 
Achievement  Test  of  Reading  and  Mathematics? 
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G.    How  important  is  it  for  you  that  your  child's  school  focus  on  the  following  areas? 

Areas  Very  important  Quite  important  Somewhat  important 

A.  Academics  

B.  Support  Services  

C.  Innovation  and  Change  

D.  Parent  Involvement  

E.  Facilities  and  Safety  

F.  Issues  in  Education  


Not  important  at  all 


H.    Overall      (Please  place  a  check  mark  in  front  of  the  word  which  best  completes  the  sentence.) 


1 .  My  child's  school  is  . 

2.  Students  are  ... 


outstanding    excellent        good  fair 

explorative    interested       attentive         bored 


How  activelv  involved... 

3.  are  the  parents  of  children  in  this  school?    highly  moderately  minimally 

4.  are  the  school's  business  partners?  highly  moderately  minimally 

5.  are  the  school's  univ./college  partners?       highly  moderately  minimally 

6.  are  the  school's  cultural  partners?  highly  moderately  minimally 

7.  is  the  school's  neighborhood?  highly  moderately  minimally 

8.  is  the  Parent  Information  Center?  highly  moderately  minimally 


poor 

disruptive 


.  I  don't  know 

.  I  don't  know 

I  don't  know 

.  I  don't  know 

I  don't  know 

I  don't  know 


I.    Please  complete  the  following  sentences: 

1 .  When  I  walk  into  my  child's  school,  I  sense  the  school  is 

2.  The  faculty  and  other  personnel  in  my  child's  school  are  , 


Other  comments  about  my  child's  school: 


Thank  you! 


Appendix  A:  Surveys 


Middle   School 
Faculty:       Middle    School    Faculty    Survey    --    1993-1994 


MIDDLE   SCHOOL    FACULTY    SURVEY    --    1993-1994 


This  school  year  (1992-1993),  I  teach  grade(s): 


8 


Other 


Dear  Colleague: 

We  want  to  know  how  we  are  doing.  Please  indicate 
how  satisfied  you  are  with  our  efforts  regarding  the  areas 
listed  below.  Please  circle  your  response  for  each  item 
using  the  scale  shown  on  the  right. 


SCALE:  4  =  Very  satisfied 
3  =  Satisfied 

2  =  Dissatisfied 

1  =  Very  dissatisfied 

0  =  1  don't  know 
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The  faculty  and  other  personnel  in  this  school ... 

A.  Voice  in  School  Governance 

1 .  ask  for  my  input  about  setting  goals  and  determining  priorities  for  the  school. 

2.  ask  me  for  suggestions  about  school  rules  and  policies  that  affect  the  children. 

3.  make  effective  use  of  my  skills,  abilities  and  talents. 

4.  reach  decisions  on  a  consensus  or  participatory  basis. 

B.  Resources 

1.  have  sufficient  funds  to  purchase  needed  supplies,  materials,  and  equipment. 

2.  have  supplies  and  materials  to  support  the  instructional  programs. 

3.  have  computer  hardware  and  software  programs  to  aid  instructional  efforts. 

4.  have  use  of  a  media  center  or  library  to  support  the  instructional  programs. 

5.  use  community  agencies  (e.g.,  health,  medical  or  legal  services)  to  help  children. 


C.  Student  Activities  &  Participation 

1.  allow  students  to  have  a  voice  in  the  types  of  activities  offered  in  the  school.  4  3  2 

2.  have  students  plan  their  own  extracurricular  activities.  4  3  2 

3.  allow  students  to  make  policies  for  governing  the  student  body.  4  3  2 

4.  offer  all  students  the  opportunity  to  participate  in  at  least  one  extracurricular  activity.  4  3  2 


D.  Support  Services 

1 .  ensure  that  children  receive  the  appropriate  special  services  they  may  need. 

2.  offer  extracurricular  activities  to  accommodate  students'  abilities  and  interests. 

3.  tutor  students  on  an  individual  or  small  group  basis. 

4.  have  cross-grade  students  tutor  on  an  individual  or  small  group  basis. 

5.  provide  counseling  or  guidance  services  to  children. 

E.  Personal/Social  Development 

1 .  teach  students  to  show  appreciation  and  gratitude  toward  others. 

2.  teach  students  to  work  in  a  team  or  group  effort. 

3.  encourage  students'  creativity  and  special  talents. 

4.  encourage  acceptance  and  respect  for  oneself  and  others  in  students. 

5.  teach  students  to  respect  and  value  ethnic/racial,  language,  and  cultural  diversity. 

6.  inspire  in  students  the  desire  for  personal  growth. 

7.  instill  in  students  the  willingness  to  take  risks. 
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SCALE:      4  =  Very  satisfied 


3  =  Satisfied 


2  =  Dissatisfied 


1  =  Very  dissatisfied 


0  =  1  don't  know 
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The  faculty  and  other  personnel  in  this  school ... 

F.  Academic  Focus 

1.  offer  a  well  balanced  curriculum. 

2.  have  high  academic  expectations  for  all  children. 

3.  assign  an  appropriate  amount  of  homework  to  students. 

4.  instruct  children  how  to: 

a)  study  and  learn. 

b)  listen  and  speak  to  an  issue  at  hand. 

c)  plan  and  make  inquiries. 

d)  conduct  research  or  solve  problems. 

e)  analyze  and  evaluate. 

f)  reason  and  make  decisions. 

g)  cooperate  and  negotiate, 
h)  govern  and  organize. 

G.  Parent  Involvement 

1 .  keep  parents  abreast  of  the  school's  activities  and  accomplishments. 

2.  keep  parents  abreast  of  their  child's  progress  in  school. 

3.  notify  parents  about  workshops  for  parents  or  the  family  (e.g.,  parenting,  literacy). 

4.  provide  parents  with  suggestions/ideas  to  support  their  children  with  school  work. 

H.  Networking  

1 .  ask  me  to  serve  on  one  or  more  committees  in  the  school. 

2.  have  students  and  faculty  members  participate  in  neighborhood  programs. 

3.  work  well  together  to  achieve  common  goals. 

4.  call  upon  businesses,  colleges/universities  or  cultural  institutions  for  help. 

5.  work  with  the  Parent  Information  Center  for  school  registration  and  other  activities. 

I.  Innovation  and  Change 

1.  use  various  sources  of  information  to  determine  student  performance. 

2.  develop  and  implement  initiatives  for  school  restructuring  (improvement). 

3.  place  children  in  classrooms  where  students  have  different  levels  of  abilities. 

4.  have  begun  to  advertise  the  school  to  parents  who  are  not  familiar  with  the  school. 
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J.  Professional  Development 

1.  encourage  dialogue  among  colleagues  within  and  across  schools.  4 

2.  provide  faculty  members  with  opportunities  to  lead  or  offer  inservice  programs.  4 

3.  offer  opportunities  for  faculty  members  to  attend  professional  development  events.  4 

4.  provide  the  faculty  with  feedback  about  effective/ineffective  instructional  practices.  4 
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SCALE:      4  =  Very  satisfied 


3  =  Satisfied 


2  =  Dissatisfied 


1  =  Very  dissatisfied  0  =  1  don't  know 


To  what  extent  are  you  satisfied  with  your  school  regarding  ... 

K.  Facilities  and  Safety 

1 .  safety  and  maintaining  order  in  the  building? 

2.  security  measures  (e.g.,  theft,  vandalism  of  automobile)  for  personal  property? 

3.  security  measures  for  protection  fi^om  physical  harm  or  injury? 

4.  maintenance  of  the  school  building(s),  classrooms,  and  grounds? 


4 

3 

2 

1 

0 

4 

3 

2 

1 

0 

4 

3 

2 

1 

0 

4 

3 

2 

1 

0 

L.  Educational  Issues 

1 .  the  number  of  students  promoted  to  the  next  grade  level? 

2.  school  funding  and  its  impact  on  maintaining  the  same  staffmg  pattern? 

3.  the  number  of  children  referred  for  discipline? 

4.  the  students'  performance  level  on  achievement  tests  such  as  the  Metropolitan 
Achievement  Test  of  Reading  and  Mathematics? 
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M.  How  important  is  it  to  you  that  your  school  focus  on  each  of  the  areas  listed  below?  Please  place  a  check  mark  in 
front  of  the  four  most  important  areas. 


Areas 

A.  Voice  in  Governance 

B.  Resources 

C.  Student  Activities  and  Participation 

D.  Support  Services 

E.  Personal/Social  Development 

F.  Academic  Focus 


Areas 
G.  Parent  Involvement 
H.  Networking 
I.    Innovation  and  Change 
J.    Professional  Development 
K.  Facilities  and  Safety 
L.  Educational  Issues 


N.  Overall      (Please  place  a  check  mark  in  front  of  the  word  which  best  summarizes  your  view.) 

1.  My  school  is...  outstanding         excellent        good  fair  poor 

2.  Students  are ...  explorative  interested       attentive        bored  disruptive 


How  actively  involved  ... 

are  parents  of  children  in  this  school?  highly  moderately  minimally  1  don't  know 

are  the  school's  business  partners?  highly  moderately  minimally  1  don't  know 

are  the  school's  university/college  partners?        highly  moderately  minimally  1  don't  know 

are  the  school's  cultural  partners?  highly  moderately  minimally  1  don't  know 

is  the  school's  neighborhood?  highly  moderately  minimally  1  don't  know 

is  the  Parent  Information  Center?  highly  moderately  minimally  1  don't  know 


0.  Please  complete  the  following  sentences: 

1 .  When  I  walk  into  my  school,  I  sense  the  school  is 

2.  The  faculty  and  other  personnel  in  this  school  are 
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Thank  you! 


. 


Appendix  A:  Surveys 


Middle    School 
Students:      A   Survey   of   Opinions   for   Middle   School 

Students 


A  SURVEY  OF  OPINIONS  FOR  MIDDLE  SCHOOL  STUDENTS 
BOSTON  PUBLIC  SCHOOLS 


This  survey  has  been  developed  to  give  you  a  chance  to  express  your  opinions  about 
your  school.  No  one  from  your  school  will  see  your  responses.  A  summary  of  responses 
from  all  students  will  be  returned  to  your  school. 

Please  answer  all  questions,  except  those  you  consider  too  personal.  This  survey  is  not  a 
test.  There  are  no  right  or  wrong  answers.  You  may  use  a  pencil,  pen  or  marker.  PLEASE 
PRINT  THE  NAME  OF  YOUR  SCHOOL  IN  THE  BOX  BELOW. 


I  SCHOOL:  I 

i_ —i 

WHEN  YOU  COMPLETE  THE  SURVEY,  PLEASE  REFOLD  THE  SURVEY 
AND  RETURN  IT  TO  YOUR  TEACHER.  If  you  have  other  comments,  please  use  a 
separate  sheet  of  paper  and  attach  it  to  the  survey. 


Please  tell  us  about  yourself. 

1.  I  have  attended  this  school  for  ... 

less  than  one  year      one  to  three  years     four  or  more  years 

2.  I  am  in  grade   6    7    8   Other 

3.  The  grades  I  usually  get  are  ... 

A'sandB's       B'sandC's       C'sandD's       D'sandE's 

4.  If  I  were  choosing  a  middle  school,  this  school  would  be  one  of  my  top  three  choices. 

Yes     No    Unsure 

5.  Usually  to  get  to  school,  it  takes  me  about: 

less  than  1 5  minutes  3 1  -  60  minutes 

15-30  minutes  more  than  1  hour 

6.  The  primary  language  spoken  in  my  home  is • 


Please  turn  the  page. 


DIRECTION:  For  each  statement  below,  circle  the  letter  that  reflects  your  typical 
experiences.  Y,  if  your  response  is  Yes 

S,  if  your  response  is  Sometimes 

N,  if  your  response  is  No 

U,  if  you  are  Unsure 

1.  I  am  proud  of  my  school  work.  Y         S  N         U 

2.  I  am  accepted  by  my  classmates  as  much  as 

most  students  my  age.  Y         S  N         U 

3.  My  teachers  have  us  work  in  small  group  projects.  Y  S  N  U 

4.  My  teachers  encourage  me  to  think  for  myself.  Y  S  N  U 

5.  The  other  students  at  school  are  nice  to  me.  Y  S  N  U 

6.  My  teachers  expect  me  to  do  my  best.  Y  S  N  .    U 

7.  I  try  to  get  as  much  from  school  as  I  can.  Y  S  N  U 

8.  My  teachers  care  about  me.  Y  S  N  ,    U 

9.  The  grown-ups  in  my  school  are  friendly  to  me.  Y  S  N  U 

10.  There  are  a  lot  of  rules  here,  but  it  makes  our 

school  better.  Y         S  N         U 

1 1 .  My  school  building  and  grounds  are  well  kept.  Y         S  N         U 

12.  Students  who  misbehave  in  school  are  dealt  with 

immediately  and  fairly.  Y         S  N         U 

13.  I  feel  safe  at  school.  Y         S  N         U 

14.  I  participate  in  at  least  one  club,  sport  or 

other  school  activity.  Y         S  N  U 

15.  I  help  plan  student  activities  or  make  suggestions 

for  student  activities.  Y         S  N         U 

16.  Someone  helps  me  at  home  when  I  need  help  with 

school  work.  Y  S  N  U 
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17.  My  parent  or  guardian  has  a  pretty  good  idea  of 

what  goes  on  in  school.  Y         S  N         U 

18.  I  enjoy  learning  from  my  teachers.  Y  S  N  U 

19.  My  teachers  use  different  ways  to  teach  me 

when  I  don't  understand  in  class.  Y         S  N         U 

20.  When  I  complete  my  class  work  before  other  students 

I  work  on  other  class  assignments.  Y  S  N  U 

21.  My  teachers  give  me  enough  time  to  answer 

a  question  when  I  am  called  upon.  Y         S  N         U 

22.  My  teachers  call  on  me  as  often  as  they  call 

on  other  students  in  my  class.  Y    '     S  N         U 

23.  Most  of  the  textbooks  used  in  my  classes  relate 

to  my  interests  and  experiences.  Y         S  N         U 

24.  My  school  work  is  challenging.  Y         S  N         U 

25.  My  teachers  or  other  grown-ups  help  me  when 

I  need  help  in  school  with  school  work.  Y         S  N         U 

26.  When  I  need  to  talk  to  a  teacher  or  grown-up, 

she  or  he  takes  time  to  talk  with  me.  Y         S  N         U 

27.  When  I  need  to  talk  to  a  grown-up  at  home, 

she  or  he  takes  time  to  talk  with  me.  Y         S  N         U 

28.  My  parent  or  guardian  attends  events  at  my  school.  Y  S  N         U 

29.  In  my  classes,  students  generally  get  the 

same  amount  of  class  work.  Y         S  N         U 

30.  I  am  comfortable  being  with  people  who  look, 

act,  dress,  or  talk  differently  from  me.  Y         S  N         U 

3 1 .  Everyone  in  this  school  expects  everybody  to 

do  their  best.  Y         S  N         U 

32.  Overall,  I  like  my  school.  Y         S  N         U 
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33.  Please  rate  the  instructional  areas 
listed  below.  Using  the  scale  shown 
on  the  right,  circle  the  letter  of  your 
response. 


Scale:     E  =  Excellent 
G  =  Good 
F  =  Fair 
P  =  Poor 

N  =  No  opinion/No  experience 


How  well  does  your  school  teach  you  to... 

a.  study  and  learn. 

b.  listen  and  speak  to  an  issue  at  hand. 

c.  plan  and  make  inquiries. 

d.  conduct  research  or  solve  problems. 

e.  analyze  and  evaluate. 

f.  govern  or  organize  (e.g.,  conduct  meetings). 

g.  reason  and  make  decisions, 
h.  petition  or  appeal  a  decision, 
i.  use  libraries  and  museums. 

j.  cooperate  and  negotiate. 

k.  use  electronic  technology  (e.g.,  video,  computer). 
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34.  What  do  you  like  best  about  your  school? 


35.  What  do  you  like  least  about  your  school? 


36.  Is  there  something  you  would  like  to  change  about  your  school?  If  so,  what,  and  how 
would  you  like  to  see  it  changed? 


THANK  YOU  FOR  COMPLETING  TfflS  SURVEY. 
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Elementary    School 
Parents        A  Survey  About  My  Child's  School   - 
1993-1994        (Domain   Set   B) 


I 

1 


A  SURVEY  ABOUT  MY  CHILD'S  SCHOOL  --  1993-1994 


For  how  many  years  have  you  enrolled  your  child(ren)  in  our  school? 


Grade  of  oldest  child  in  our  school: 


Dear  Parent/Guardian: 

We  want  to  know  how  we  are  doing.  Please  tell  us 
how  satisfied  you  are  with  our  efforts  regarding  the 
areas  listed  below.  Please  circle  your  response  for  each 
item  using  the  scale  shown  on  the  right. 


SCALE:  4  =  Very  satisfied 
3  =  Satisfied 

2  =  Dissatisfied 

1  =  Very  dissatisfied 

0  =  1  don't  know 


My  child's  school...  SCALE 

A.  Academic  Focus 

1 .  offers  a  well  balanced  curriculum. 

2.  has  high  academic  expectations  for  all  children. 

3.  assigns  an  appropriate  amount  of  homework  to  students. 

4.  teaches  my  child  how  to  : 

a.  study  and  learn. 

b.  listen  and  speak  to  the  issue  at  hand. 

c.  conduct  research  or  solve  problems.  _ 

d.  plan  and  make  inquiries. 

e.  analyze  and/or  evaluate. 

f.  reason  and  make  decisions. 

g.  cooperate  and  negotiate. 


4 

3 

2 

1          0 

4 

3 

2 

1          0 

4 

3 

2 

1          0 

4 

3 

2 

1          0 

4 

3 

2 

I          0 

4 

3 

2 

1          0 

4 

3 

2 

I          0 

4 

3 

2 

1          0 

4 

3 

2 

I          0 

4 

3 

2 

I          0 

B.  Support  Services 

1 .  makes  sure  that  children  receive  the  appropriate  special  services  they  may  need.  4 

2.  offers  extracurricular  activities  to  accommodate  students'  abilities  and  interests.  4 

3.  has  teachers  who  tutor  students  on  an  individual  or  small  group  basis.  4 

4.  has  cross-grade  students  tutor  on  an  individual  or  small  group  basis.  4 

C.  Innovation  and  Change 

1 .  uses  various  sources  of  information  to  determine  student  performance.  4 

2.  is  changing  the  way  the  school  is  operated  and  is  managed.  4 

3.  places  my  child  in  a  classroom  where  students  have  different  levels  of  abilities.  4 

4.  has  begun  to  advertise  the  school  to  parents  who  are  not  familiar  with  the  school.  4 


2 
2 
2 
2 


D.    Parent  Involvement 

1.  keeps  me  aware  of  the  school's  activities  and  accomplishments.  4  3  2 

2.  keeps  me  aware  of  my  child's  progress  in  school.  4  3  2 

3.  notifies  me  about  workshops  for  parents  or  the  family  (e.g.,  parenting  skills,  literacy).  4  3  2 

4.  provides  me  with  suggestions/ideas  to  support  my  child  with  his/her  school  work.  4  3  2 


0 
0 
0 
0 


0 
0 
0 
0 


0 
0 
0 
0 
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SCALE:    4  =  Very  satisfied  3  =  Satisfied 


2  =  Dissatisfied 


1  =  Very  dissatisfied  0  =  1  don't  know 


My  child's  school... 

E.    Facilities  and  Safety 

1 .  provides  a  safe  and  orderly  environment.  4  3 

2.  makes  sure  that  the  school  building(s),  classrooms,  and  grounds  are  well-maintained.    4  3 

3.  makes  sure  that  students' and  faculty's  personal  property  is  safe  from  theft.  4  3 

4.  makes  sure  that  everyone  can  walk  about  freely  without  fear  of  physical  harm  4  3 
or  injury. 


SCALE 


2 

1 

0 

2 

1 

0 

2 

1 

0 

2 

1 

0 

p.    Educational  Issues 

With  regard  to  your  child's  school,  to  what  extent  are  you  satisfied  with... 

1 .  the  number  of  students  promoted  to  the  next  grade  level?  4 

2.  school  funding  and  its  impact  on  maintaining  the  same  staffing  pattern?  4 

3.  the  number  of  children  entering  school  with  no  preschool  or  kindergarten  experience?  4 

4.  the  students'  performance  level  on  achievement  tests  such  as  the  Metropolitan  4 
Achievement  Test  of  Reading  and  Mathematics? 


3 

2 

1 

0 

3 

2 

1 

0 

3 

2 

1 

0 

3 

2 

1 

•  0 

G.    How  important  is  it  for  you  that  your  child's  school  focus  on  the  following  areas? 


Areas 

A.  Academics 

B.  Support  Services 

C.  Innovation  and  Change 

D.  Parent  Involvement 

E.  Facilities  and  Safety 

F.  Issues  in  Education 


Very  important     Quite  important     Somewhat  important         Not  important  at  all 


H.    Overall      (Please  place  a  check  mark  in  front  of  the  word  which  best  completes  the  sentence.) 

1.  My  child's  school  is  ...  outstanding    excellent 

2.  Students  are  ...  explorative    interested 


How  actively  involved... 

3.  are  the  parents  of  children  in  this  school?  highly 

4.  are  the  school's  business  partners?  highly 

5.  are  the  school's  univ./college  parmers?  highly 

6.  are  the  school's  cultural  partners?  highly 

7.  is  the  school's  neighborhood?  highly 

8.  is  the  Parent  Information  Center?  highly 


good 

fair 

poor 

attentive 

bored 

disruptive 

moderately 

minimally 

I  don't  know 

moderately 

minimally 

I  don't  know 

moderately 

minimally 

I  don't  know 

moderately 

minimally 

I  don't  know 

moderately 

minimally 

I  don't  know 

moderately 

minimally 

I  don't  know 

I.    Please  complete  the  following  sentences: 

1 .  When  I  walk  into  my  child's  school,  I  sense  the  school  is 

2.  The  faculty  and  other  personnel  in  my  child's  school  are  . 


Other  comments  about  my  child's  school: 


Thank  you! 
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Elementary    School 
Faculty:       Elementary   School    Faculty    Survey 

1993-1994 


ELEMENTARY  SCHOOL  FACULTY  SURVEY  --  1993-1994 


This  school  year  (1992-1993),  I  teach  grade(s): 


K 


1 


Other 


Dear  Colleague: 

We  want  to  know  how  we  are  doing.  Please  indicate 
how  satisfied  you  are  with  our  efforts  regarding  the  areas 
listed  below.  Please  circle  your  response  for  each  item 
using  the  scale  shown  on  the  right. 


SCALE:  4  =  Very  satisfied 
3  =  Satisfied 

2  =  Dissatisfied 

1  =  Very  dissatisfied 

0  =  1  don't  know 


4 

3 

2 

I          0 

4 

3 

2 

0 

4 

3 

2 

1          0 

4 

3 

2 

1          0 

4 

3 

2 

1          0 

The  faculty  and  other  personnel  in  this  school ... 

A.  Voice  in  School  Governance 

1.  ask  for  my  input  about  setting  goals  and  determining  priorities  for  the  school.  4  3  2  10 

2.  ask  me  for  suggestions  about  school  rules  and  policies  that  affect  the  children.  4  3  2  10 

3.  make  effective  use  of  my  skills,  abilities  and  talents.  4  3  2  10 

4.  reach  decisions  on  a  consensus  or  participatory  basis.  4  3  2  10 


B.  Resources 

1.  have  sufficient  funds  to  purchase  needed  supplies,  materials,  and  equipment. 

2.  have  supplies  and  materials  to  support  the  instructional  programs. 

3.  have  computer  hardware  and  software  programs  to  aid  instructional  efforts. 

4.  have  use  of  a  media  center  or  library  to  support  the  instructional  programs. 

5.  use  community  agencies  (e.g.,  health,  medical  or  legal  services)  to  help  children. 


C.  Student  Activities  &  Participation 

1.  allow  students  to  have  a  voice  in  the  types  of  activities  offered  in  the  school.  4 

2.  have  students  plan  their  own  extracurricular  activities.  4 

3.  allow  students  to  make  policies  for  governing  the  student  body.  4 

4.  offer  all  students  the  opportunity  to  participate  in  at  least  one  extracurricular  activity.  4 


D.  Support  Services 

1 .  ensure  that  children  receive  the  appropriate  special  services  they  may  need. 

2.  offer  extracurricular  activities  to  accommodate  students'  abilities  and  interests. 

3.  tutor  students  on  an  individual  or  small  group  basis. 

4.  have  cross-grade  students  tutor  on  an  individual  or  small  group  basis. 

5.  provide  counseling  or  guidance  services  to  children. 

E.  Personal/Social  Development 

1 .  teach  students  to  show  appreciation  and  gratitude  toward  others. 

2.  teach  students  to  work  in  a  team  or  group  effort. 

3.  encourage  students'  creativity  and  special  talents. 

4.  develop  in  each  student  acceptance  and  respect  for  oneself  and  others. 

5.  teach  students  to  respect  and  value  ethnic/racial,  language,  and  culmral  diversity. 

6.  inspire  in  students  the  desire  for  personal  growth. 

7.  instill  in  students  the  willingness  to  take  risks. 


2 
2 
2 
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1          0 
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SCALE:     4  =  Very  satisfied 


3  =  Satisfied 


2  =  Dissatisfied 


1  =  Very  dissatisfied  0  =  1  don't  know 


The  faculty  and  otiier  personnel  in  this  school ... 

F.  Academic  Focus 

1 .  offer  a  well  balanced  curriculum.  4  3  2 

2.  have  high  academic  expectations  for  all  children.  4  3  2 

3.  assign  an  appropriate  amount  of  homework  to  students.  4  3  2 

4.  instruct  children  how  to: 

a)  study  and  learn.  4  3  2 

b)  listen  and  speak  to  an  issue  at  hand.  4  3  2 

c)  plan  and  make  inquiries.  4  3  2 

d)  conduct  research  or  solve  problems.  4  3  2 

e)  analyze  and  evaluate.  4  3  2 

f)  reason  and  make  decisions.  4  3  2 

g)  cooperate  and  negotiate.  4  3  2 

G.  Parent  Involvement 

1.  keep  parents  abreast  of  the  school's  activities  and  accomplishments.  4  3  2 

2.  keep  parents  abreast  of  their  child's  progress  in  school.  4  3  2 

3.  notify  parents  about  workshops  for  parents  or  the  family  (e.g.,  parenting,  literacy).  4  3  2 

4.  provide  parents  with  suggestions/ideas  to  support  their  children  with  school  work.  4  3  2 

H.  Networking 

1 .  ask  me  to  serve  on  one  or  more  committees  in  the  school.  4  3  2 

2.  have  students  and  faculty  members  participate  in  neighborhood  programs.  4  3  2 

3.  work  well  together  to  achieve  common  goals.  4  3  2 

4.  call  upon  businesses,  colleges/universities  or  cultural  institutions  for  help.  4  3  2 

5.  work  with  the  Parent  Information  Center  for  school  registration  and  other  activities.  4  3  2 

I.  Innovation  and  Change 

1 .  use  various  sources  of  information  to  determine  student  performance.  4  3  2 

2.  develop  and  implement  initiatives  for  school  restructuring  (improvement).  4  3  2 

3.  place  children  in  classrooms  where  students  have  different  levels  of  abilities.  4  3  2 

4.  have  begun  to  advertise  the  school  to  parents  who  are  not  familiar  with  the  school.  4  3  2 

J.  Professional  Development 

1 .  encourage  dialogue  among  colleagues  within  and  across  schools.  4  3  2 

2.  provide  faculty  members  with  opportunities  to  lead  or  offer  inservice  programs.  4  3  2 

3.  offer  opportunities  for  faculty  members  to  attend  professional  development  events.  4  3  2 

4.  provide  the  faculty  with  feedback  about  effective/ineffective  instructional  practices.  4  3  2 


R&D/9301 
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SCALE:      4  =  Very  satisfied 


3  =  Satisfied 


2  =  Dissatisfied 


1  =  Very  dissatisfied  0  =  1  don't  know 


To  what  extent  are  you  satisfied  with  your  school  regarding  ... 

K.  Facilities  and  Safety 

1 .  safety  and  maintaining  order  in  the  building? 

2.  security  measures  (e.g.,  theft,  vandalism  of  automobile)  for  personal  property? 

3.  security  measures  for  protection  from  physical  harm  or  injury? 

4.  maintenance  of  the  school  building(s),  classrooms,  and  grounds? 


4 

3 

2 

1 

0 

4 

3 

2 

1 

0 

4 

3 

2 

1 

0 

4 

3 

2 

1 

0 

L.  Educational  Issues 

1 .  the  number  of  students  promoted  to  the  next  grade  level?  4 

2.  school  funding  and  its  impact  on  maintaining  the  same  staffing  pattern?  4 

3.  the  number  of  children  entering  school  with  no  preschool  or  kindergarten  experience?  4 

4.  the  students'  performance  level  on  achievement  tests  such  as  the  Metropolitan  4 
Achievement  Test  of  Reading  and  Mathematics? 


3 

2 

1 

0 

3 

2 

1 

0 

3 

2 

1 

0 

3 

2 

1 

0 

M.  How  important  is  it  to  you  that  your  school  focus  on  each  of  the  areas  listed  below?  Please  place  a  check  mark  in 
front  of  the  four  most  important  areas. 


Areas 

A.  Voice  in  Governance 

B.  Resources 

C.  Student  Activities  and  Participation 

D.  Support  Services 

E.  Personal/Social  Development 

F.  Academic  Focus 


Areas 
G.  Parent  Involvement 
H.  Networking 
I.    Innovation  and  Change 
J.    Professional  Development 
K.  Facilities  and  Safety 
L.  Educational  Issues 


N.  Overall      (Please  place  a  check  mark  in  front  of  the  word  which  best  summarizes  your  view.) 

1.  My  school  is  ...  outstanding         excellent  good  fair  poor 

2.  Students  are ...  explorative  interested  attentive  bored  disruptive 

How  actively  involved  ... 

3.  are  parents  of  children  in  this  school?  highly  moderately  minimally  I  don't  know 

4.  are  the  school's  business  partners?  highly  moderately  minimally  I  don't  know 

5.  are  the  school's  university/college  partners?        highly  moderately  minimally  I  don't  know 

6.  are  the  school's  cultural  partners?  highly  moderately  minimally  I  don't  know 

7.  is  the  school's  neighborhood?  highly  moderately  minimally  I  don't  know 

8.  is  the  Parent  Information  Center?  highly  moderately  minimally  I  don't  know 


0.  Please  complete  the  following  sentences: 

1 .  When  I  walk  into  my  school,  I  sense  the  school  is 

2.  The  faculty  and  other  personnel  in  this  school  are 


Comments: 


Thank  you ! 
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Elementary    School 
Students:     We'd   Like  to   Hear   From  You... 


We'd  Like  to  Hear  From  You... 


Boston  Public  Schools 

Grades  3-5 


We  would  like  to  know  about  you  and  your  school.  If  your  answer  to  a  question  on  this 
sheet  is  yes,  circle  the  word  "Yes."  Circle  the  word  "No",  if  your  answer  is  no.  If  you  are 
not  sure,  circle  "Unsure." 


1 .  I  am  proud  of  my  school  work. 

2.  I  learn  every  day  at  school. 

3.  I  do  my  best  every  day  at  school. 

4.  I  like  to  learn  from  my  teacher. 

5.  Homework  helps  me  with  my  class  work. 

6.  The  grown-ups  in  my  school  are  friendly. 

7.  The  school  rules  help  us  to  learn  in  school. 

8.  The  children  in  school  are  nice  to  me. 

9.  I  have  friends  to  play  with  in  school. 

10.  I  enjoy  going  to  school. 

1 1 .  I  like  my  school  building  and  playground. 

12.  I  feel  safe  at  school. 

13.  My  teacher  helps  me  when  I  need  help  in  school. 

14.  Someone  helps  me  at  home  when  I  need  help 
with  school  work. 


Yes 


Yes 


Yes 


Yes 


Yes 


Yes 


Yes 


Yes 


Yes 


Yes 


Yes 


Yes 


Yes 


Yes 


No 


No 


No 


No 


No 


Unsure 


No         Unsure 


No         Unsure 


Unsure 


No         Unsure 


No         Unsure 


No         Unsure 


No         Unsure 


Unsure 


Unsure 


No         Unsure 


Unsure 


No         Unsure 


No         Unsure 


15.  I  like  my  school. 


Yes 


No         Unsure 


I 
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Appendix  B:  Statistical  Procedures 


Statistical  Procedures 

STATISTICAL  TERMS  AND  TECHNIQUES 

The  purpose  of  this  appendix  is  to  provide  some  help  in  obtaining,  understand- 
ing and  using  data  for  educational  planning  and  evaluation.  While  it  can  only  be  an  in- 
troduction, it  should  help  demystify  "statistics"  and  make  them  more  accessible  for  use 
by  educators.  The  statistical  references  listed  in  Bibliography  will  be  useful  for  those 
w^ho  wish  to  learn  more. 

INTRODUCTION 

Many  people  shiver  when  they  encounter  the  word  "statistics"  and  assume  that 
statistics  are  mysterious  and  complicated.  Perhaps  for  that  same  reason,  many  people 
distrust  reports  which  use  statistics,  claiming  that  "you  can  make  statistics  say  anything 
you  want." 

It  is  generally  said  that  there  are  three  major  reasons  statistics  are  used:  to  de- 
scribe data,  to  generate  hypotheses  (by  exploring  data),  or  to  test  hypotheses  (in  order 
to  make  inferences  about  a  whole  group  based  on  information  from  part  of  the  group) 
(Fitz-Gibbon  and  Morris,  1991). 

In  the  context  of  planning  for  school  improvement,  most  of  the  uses  for  data  will 
be  descriptive.  The  purpose  of  collecting  statistics  such  as  a  school's  status  on  an  educa- 
tional indicator  is  to  summarize  how  the  school  is  doing  in  a  particular  area.  Data  can 
be  used  to  compare  the  school  to  itself  over  time,  or  to  the  BPS  as  a  whole  at  one  point 
in  time. 

What  follows  are  some  of  the  more  common  statistical  terms  and  their  computa- 
tions, if  appropriate,  organized  under  the  following  categories.  (Calculation  formulas 
are  provided  for  convenience  but  may  be  skipped  over  without  loss  of  understanding  of 
the  explanation.) 


If  vou  would  like  to  know  more  about ... 


General  Terms   Stat-  2 

Measures  of  Test  Performance  Stat-  5 

Measures  of  Central  Tendency    Stat-  6 

Measures  of  Variability    Stat-  8 

Concepts  Associated  with  Assessment  and  Testing  Stat-  9 


BPS  R&D  Stat-1  6/1993 
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GENERAL 

Qualitative  And  Quantitative  Data 

"Qualitative"  data  refers  to  information  in  the  form  of  words,  descriptions  of 
events,  and  so  on.  Analyzing  qualitative  data  mear^  trying  to  discern  the  meaning  of 
events.  "Quantitative  data"  either  are,  or  are  reducible  to,  numbers  and  numerical  mea- 
sures. Counting,  rating,  weighing,  ranking,  to  name  a  few,  result  in  quantitative  in- 
formation. Ideally,  evaluating  a  phenomenon  as  complex  as  a  school  would  be  done 
using  both  types  of  data. 

Variables 

A  variable  is  a  piece  of  information  which  can  take  on  differing  values.  Gender, 
median  percentiles  on  the  MAT6,  and  average  daily  attendance  are  all  variables.  The 
Systemwide  Indicators  are  variables  used  to  iiifluence  the  planning  process.  In  re- 
search, evaluation,  and  planning,  variables  are  often  studied  in  terms  of  their  relation- 
ship to  each  other.  For  instance,  many  educators  believe  that  more  time  spent  on 
instruction  will  be  related  to  better  test  scores. 

Frequency  Distribution 

Preparing  a  frequency  distribution  is  a  conimon  way  of  summarizing  a  set  of 
quantitative  data.  It  is  a  tabulation  which  shows  the  number  of  occurrences  of  each 
score  or  each  range  of  scores  (or  ratings,  or  some  other  characteristic).  For  example, 
suppose  the  staff  of  a  school  were  asked  to  rate  the  school,  given  the  alternatives, 
"Excellent",  "Good",  and  "Fair  or  Poor".  A  possible  frequency  distribution  for  a  staff  of 
50  might  be  as  follows: 

Excellent  25                  50% 

Good  15                  30% 

Fair/Poor  5                  10% 

No  reply  5 10% 

TOTAL  50  100% 

(One  could  conclude  from  these  data  that  staff  thought  the  school  was  doing  quite  a 
good  job.) 

Cross  Tabulation 

A  cross-tabulation  is  a  common  way  of  displaying  data  when  the  variables  are 
categories.  Combined  with  some  specialized  statistics,  it  can  be  used  as  a  way  of  dis- 
cerning if  there  is  an  association  between  two  characteristics.   For  example,  suppose  a 

BPSR&D  Stat -2  6/1993 
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high  school  looks  into  how  students  choose  electives;  they  want  to  know  if  there  is  a  dif- 
ference in  how  males  and  females  are  making  their  choices.  Data  based  on  a  mythical 
group  of  200  students  show  how  this  might  be  done: 


Science /Math 

All  Other 
Electives 

No 
Electives 

Total 

N4ALE 
FEMALE 

40 

20 

20 

40 

40 
40 

100 
100 

TOTAL 

60 

60 

80 

200 

(A  cross  tabulation  would  ordinarily  show  percentages  as  well  as  cell  counts). 

A  quick  look  at  these  data  suggests  that  males  are  more  likely  to  choose  science 
and  math  courses  than  are  females.  Specialized  statistics  (such  as  those  based  on  the 
"Chi-Square"  distribution)  can  tell  us  how  "strong"  this  finding  is  -  whether,  if  the  study 
were  repeated,  the  results  would  be  similar  or  not.  Note  that  the  data  tell  us  nothing 
about  why  the  associations  we  observe  might  occur. 

Correlation 

The  correlation  between  two  sets  of  scores  is  a  statistic  calculated  as  a  number 
which  can  vary  between  -1  and  +1.  It  is  a  measure  of  association,  an  index  of  the  degree 
to  which  scores  on  one  variable  can  be  predicted  by  scores  on  another  -  the  degree  to 
which  two  variables  "go  together"  or  "covary".  Academic  achievement  and  perform- 
ance on  the  MAT6  is  an  example  of  two  variables  likely  to  be  positively  correlated.  That 
is,  if  one  is  high,  the  other  is  likely  to  be,  and  the  correlation  statistic  approaches  +1 
(Note  that  this  expresses  the  relahonship  on  average;  all  teachers  know  some  students 
with  good  scores  who  do  not  perform  well  academically,  and  vice  versa.)  An  example 
of  a  negative  correlation  (the  statistic  is  less  than  zero)  is  likely  to  be  the  relationship  be- 
tween hours  of  television  watched  and  academic  performance.  A  correlation  close  to 
zero  reflects  no  relationship  between  the  two  variables.  An  example  might  be  the  rela- 
tionship between  age  and  IQ  in  a  school-aged  population. 

All  beginning  researchers  are  taught  the  maxim  that  "correlation  does  not  imply 
causation."  That  two  variables  are  correlated  is  not  sufficient  reason  to  be  able  to  say 
that  one  "causes"  the  other.  In  some  instances  the  relationship  may  be  causal;  on  the  oth- 
er hand,  both  variables  may  be  related  to  some  other  factor  which  is  causal.  A  classic 
example  is  ice  cream  consumption  and  crime.  There  is  a  positive  correlation  between 
the  two,  but  it  is  unlikely  that  one  causes  the  other.  More  likely,  both  are  associated 
with  warm  weather.  While  this  example  is  "obvious",  many  others  are  subtle,  and  the 
maxim  is  easy  to  forget. 
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Sample  and  Population 

These  are  key  concepts  in  research.  Often,  a  researcher  wants  to  be  able  to  make 
inferences  about  a  whole  group  (population)  based  on  information  from  a  subgroup 
(sample).  A  familiar  example  is  political  polling.  Based  on  a  sample  of  voters  chosen 
carefully  to  be  representative  of  the  nation  as  a  whole,  it  is  possible  to  predict  quite  ac- 
curately what  the  outcome  of  an  election  will  be.  Up  to  a  point,  the  larger  the  sample 
relative  to  the  total  population,  the  more  accurate  the  inferences  will  be;  beyond  the 
point,  however,  an  increase  in  sample  size  does  not  appreciably  improve  accuracy  of 
the  inference.  However,  the  sample  must  also  be  representative.  That  is,  the  composi- 
tion of  the  sample  group  must  resemble  that  of  the  population  in  factors  likely  to  influ- 
ence the  outcomes.  For  an  election,  these  factors  include  age,  income  level,  gender, 
racial/ethnic  group,  and  region  of  the  country,  among  others. 

These  considerations  are  important  in  BPS  settings  when  questionnaires  are  ad- 
ministered. If  a  school  wants  to  know  how  the  parents  feel  about  the  school's  perform- 
ance, it  should  make  an  effort  to  include  appropriate  proportions  of  parents  in  various 
categories.  For  instance,  the  racial /ethnic  group  composition  of  the  sample  should  be 
fairly  close  to  that  of  the  school  as  a  whole. 

In  general,  a  random  sample  is  one  in  which  each  member  of  the  population  has  an 
equal  chance  of  being  selected,  and  the  selection  of  one  member  does  not  have  an  im- 
pact on  the  likelihood  of  selecting  another.  That  is,  there  is  no  systematic  bias  in  how 
people  are  chosen. 

Statistical  Significance 

This,  concept  is  at  the  heart  of  the  process  of  statistical  inference.  In  the  cross- 
tabulation  on  page  3,  it  appears  from  the  sample  that  in  High  School  X,  males  were 
more  likely  than  females  to  choose  science  and  math  electives.  But  is  this  difference 
"real"?  The  200  students  were  a  sample  of  the  whole  population  of  students  at  the 
school.  What  if  the  study  were  repeated?  Would  the  results  be  the  same?  Suppose  that 
among  High  School  X  students  as  a  whole  there  is  no  actual  association  between  course 
choice  and  gender.  How  likely  is  it  that  the  data  observed  based  on  a  sample  could 
have  occurred  by  chance?  Consider  another  example,  that  of  tossing  a  "fair"  coin.  Out 
of  100  tosses,  one  expects  about  50  heads  by  chance.  Fifty-three  or  47  would  not  be  sur- 
prising either,  since  they  are  close  to  50.  But  what  if  oiUy  39  heads  turned  up  out  of  100 
tosses?  At  what  point  would  we  believe  that  the  coin  was  not  fair?  When  would  we 
think  that  the  coin  tosses  were  not  occurring  by  truly  random  chance,  but  were  due  to 
some  other  process  (like  someone's  having  weighted  the  coin)? 

The  overall  process  of  statistical  inference,  using  a  very  wide  variety  of  tech- 
niques and  calculations,  is  a  way  of  providing  systematic  answers  to  the  types  of  ques- 
tions asked  above.  The  assumption  that  a  given  set  of  observations  occurred  solely  by 
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chance  -  that  there  is  no  actual  association  between  course  choice  and  gender  in  High 
School  X,  or  that  the  coin  is  fair,  or  that  there  is  no  difference  in  efficacy  between  a  new 
drug  and  a  placebo  -  is  called  the  "null  hypothesis."  Often  the  researcher  holds  an  alter- 
native hypothesis:  that  gender  and  course  choice  are  associated;  that  the  new  drug  is 
more  effective  than  a  placebo;  or  that  students  exposed  to  Curriculum  A  will  perform 
better  than  those  who  receive  Curriculum  B. 

What  can  seem  strange  about  statistical  inference  is  that  technically  one  cannot 
"prove"  the  alternative  hypothesis.  One  can  only  "fail  to  confirm"  the  null  hypothesis. 
This  means  that  the  observed  results  were  so  unlikely  to  have  come  about  by  chance 
that  we  reject  the  idea  that  chance  factors  alone  were  operating.  The  various  statistics 
calculated  are  largely  ways  of  evaluating  exactly  how  likely  it  is  that  the  observed  re- 
sults occurred  due  to  chance  factors  alone.  If  the  likelihood  is  sufficiently  low  (1  chance 
in  20,  or  5%,  is  often  used  as  a  criterion),  the  observed  results  are  said  to  be  "statistically 
significant." 

If  a  finding  is  statistically  significant,  it  implies  that  the  outcome  would  be  simi- 
lar if  the  study  were  repeated.  However,  it  must  be  pointed  out  that  "statistical  signifi- 
cance" does  not  always  imply  "practical  significance."  Any  results  from  the  process  of 
statistical  inference  must  be  interpreted  with  respect  to  the  context  and  the  phenomena 
they  describe.  If  two  samples  were  very  large,  a  difference  of  one  point  between  the 
two  groups  on  a  100  item  achievement  test  might  be  statistically  significant.  However, 
it  is  unlikely  that  such  a  small  difference  would  have  much  educational  significance. 

MEASURES  OF  TEST  PERFORMANCE 

Raw  Score 

The  raw  score  is  simply  the  number  of  items  on  a  test  answered  correctly.  Some- 
times the  raw  score  may  be  reported  as  a  percentage  or  proportion.  By  themselves,  raw 
scores  provide  limited  information,  since  they  provide  no  ready  means  of  comparison. 

Percentile  and  Percentile  Rank 

Technically,  a  percentile  is  the  raw  score  in  a  group  of  scores  below  which  a  cer- 
tain percentage  of  people  scored.  For  example,  if,  on  a  50  item  test,  Julio  gets  42  correct, 
and  that  score  is  better  than  90  percent  of  the  other  scores,  then  42  is  the  90th  percentile, 
and  90  is  the  percentile  rank. 

In  BPS  settings,  the  typical  use  of  the  percentile  concept  is  in  reporting  Metro- 
politan Achievement  Test  (MAT6)  data.  Under  most  circumstances,  individual  stu- 
dents' scores  are  reported  as  percentile  ranks,  but  in  most  instances  they  are  referred  to 
simply  as  "percentiles".  See  below  under  Median  for  a  discussion  of  how  "average" 
MAT6  scores  for  groups  of  students  are  reported. 
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NCE  (Normal  Curve  Equivalent) 

The  NCE  is  derived  from  the  percentile  rank,  and,  like  percentile  ranks,  varies 
from  1  to  99.  For  technical  reasons,  it  differs  from  percentile  ranks  in  how  it  can  be  in- 
terpreted. A  difference  in  5  NCE  points  has  the  same  meaning  (in  terms  of  differences 
in  performance)  at  any  point  along  the  scale  -  whether  the  comparison  is  between  5  and 
10  NCE  points  or  52  and  57  or  82  and  87  NCE  points.  The  same  is  not  true  for  percentile 
ranks.  A  difference  of  5  percentile  rank  points  reflects  a  larger  difference  in  perform- 
ance at  the  extremes  of  the  scale  (closer  to  1  or  99)  than  it  does  in  the  middle  (closer  to 
50).  For  this  reason,  NCE's  or  scaled  scores  (see  page  10)  are  preferred  to  percentile 
ranks  for  purposes  of  evaluating  federal  programs  such  as  Chapter  I.  Whenever  mathe- 
matical operations  such  as  addition  or  division  need  to  be  performed,  percentile  ranks 
are  inappropriate  to  use.  For  example,  if  one  wants  to  examine  the  difference  in  stu- 
dents' performance  between  one  year  and  the  next,  NCE's  should  be  used  instead  of 
percentile  ranks  because  the  comparison  would  involve  subtracting  one  year's  scores 
from  the  other's. 

Grade  Equivalent 

Grade  Equivalents  (GE's)  are  an  intuitively  appealing  way  to  report  standardized 
test  scores,  since  they  express  performance  in  terms  of  grade  year  and  month.  A  grade 
equivalent  of  6.4  means  that  the  student  got  the  same  number  of  items  correct  on  the 
test  as  6th  graders  in  their  4th  month  would  be  expected  to.  However,  Grade  Equiva- 
lents can  be  misleading,  especially  if  they  are  more  than  two  grades  away  from  the  stu- 
dent's current  grade.  A  6th  grader  who  performs  very  well  on  a  test  and  gets  a  Grade 
Equivalent  of  11.5  has  performed  as  well  as  the  average  11th  grader  would  have  had  he 
or  she  taken  the  6th  grade  test.  However,  this  student  has  not  been  tested  on  the  same 
items  as  11th  graders,  and  therefore  cannot  be  said  to  be  able  to  perform  in  general  as 
an  11th  grader  would.  The  GE  should  be  interpreted  in  this  case  as  the  student  scoring 
well  above  average  for  his  or  her  grade. 

MEASURES  OF  CENTRAL  TENDENCY 

One  often  wants  to  know  how  the  "average"  person  did  on  a  test,  or  what  "most 
parents"  felt  about  a  workshop  in  which  they  participated.  We  are  looking  for  "central 
tendency"  -  the  way  to  summarize  results  which  gives  an  overall  picture.  There  are  sev- 
eral measures  which  can  be  used. 

Mean  (or  Arithmetic  Average) 

The  mean  of  a  set  of  numbers  is  obtained  by  sununing  the  numbers  and  then  di- 
viding by  the  count  of  the  numbers  which  were  summed.  For  example,  the  mean  of  25, 
35,  45,  and  55,  is  40.  The  sum  of  the  4  numbers  is  160,  and  that  sum  is  divided  by  4  (the 
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number  of  numbers  which  were  summed)  gives  the  result  of  40.  This  is  the  most  famil- 
iar "average". 

Median 

The  median  is  the  "middle  score"  of  a  set  of  numbers.  The  number  of  scores 
above  the  median  is  the  same  as  the  number  of  scores  below  the  median.  For  a  relative- 
ly small  set  of  numbers,  the  median  can  be  obtained  by  writing  the  numbers  in  ascend- 
ing order,  and  counting  halfway  down  the  list  if  there  is  an  odd  number  of  numbers.  If 
there  is  an  even  number  of  numbers,  say,  10,  the  value  halfway  between  the  two  closest 
to  the  middle  is  chosen. 

Examples: 

a)  20,  3,  6,  7,  2.  Rearrange  to:  2,  3,  6,  7,  20.  The  median  is  6  (odd  number  of  numbers  in  the 
list). 

b)  3,  6,  7,  2.  Rearrange  to  2,  3,  6,  7.  The  two  numbers  "closest"  to  the  middle  are  3  and  6.  Half- 
way between  3  and  6  is  found  as  follows:  (6-3)  =  3,  divided  by  2  =  1 .5;  add  1 .5  to  3,  for  a  re- 
sult of  4.5. 

In  BPS,  MAT6  scores  for  groups  of  students  are  typically  reported  as  median  per- 
centiles. For  instance,  suppose  a  school's  6th  grade  had  a  "median  percentile"  of  54  on 
the  mathematics  test.  This  means  that  half  of  the  students  in  the  6th  grade  scored  better 
than  54%  of  the  nationwide  group  of  students  used  to  develop  the  norms  on  the  test.  If 
the  BPS  students  had  performed  at  exactly  the  same  level  as  the  national  norm  group, 
their  median  percentile  would  have  been  50.  Since  the  BPS  median  percentile  (54)  was  4 
points  higher  than  the  median  percentile  for  the  national  group  (always  50,  by  defini- 
tion), the  BPS  students  did  somewhat  better  than  the  national  group.  If  a  BPS  median 
percentile  is  below  50,  this  means  that  on  average  the  BPS  group  did  less  well  than  the 
national  norm  group.  The  median  is  not  as  sensitive  to  extreme  scores  as  the  mean. 
Thus,  it  represents  a  "typical  score"  as  the  middle  score.  This  type  of  measure  of  central 
tendency  is  useful  when  the  scores  do  not  have  a  symmetric  (i-e-,  "bell-shaped")  distri- 
bution, as  can  be  the  case  in  BPS  classes  and  schools. 

Mode 

The  mode  is  the  score  or  value  that  occurs  most  frequently  in  a  distribution  of 
ntambers.  It  might  be  useful  in  the  case  where  the  user  is  looking  for  a  "typical  score" 
and  the  distribution  of  scores  is  such  that  there  are  several  distinct  peaks  to  the  data. 
For  example,  see  Figure  1 .  In  practice,  the  mode  is  rarely  used  for  reporting  educational 
performance. 
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Figure  1 

Fictional  Distribution  of  Test  Scores  for  Grade  4: 
Using  the  Mode  to  Determine  the  "Typical  Score" 
100-,  3  "typical  scores" 

80- 
60- 
40- 
20- 
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Percentile  Rank 


MEASURES  OF  VARIABILITY 


I 


In  a  group  of  scores,  there  is  usually  some  variability.  Consider  two  groups  of 
scores: 

a)  10,20,30,40,50 

b)  30,30,30,30,30. 

Both  have  the  same  mean  and  the  same  median  (i.e.,  mean=median=30).  How- 
ever, there  is  much  more  variation  in  the  first  set  of  data  than  in  the  second  set. 

Range 

The  range  is  simply  the  difference  between  the  lowest  value  and  the  highest  val- 
ue in  a  set  of  numbers.  For  example,  the  range  of  1,  2,  3,  4,  and  70  is  69  (=70  -  1).  Note 
that  in  this  example  the  range  is  somewhat  misleading,  since  most  of  the  numbers  are 
clustered  close  to  1.  To  get  around  this  problem,  another  way  to  express  a  range  is  to 
calculate  the  difference  between  the  75th  percentile  and  the  25th  percentile  of  a  distribu- 
tion of  numbers  (i.e.,  the  middle  50%  of  data  points).  For  these  data  the  interquartile 
range  would  be  2  (because  2=25th  percentile  and  4=75th  percentile). 

Variance  and  Standard  Deviation 

The  variance  and  standard  deviation  are  indices  of  the  average  distance  a  score 
or  point  in  a  data  set  is  from  the  mean  (arithmetic  average).  The  variance  is  calculated 
by  finding  the  difference  between  each  value  and  the  mean,  squaring  each  difference 
(multiplying  it  by  itself),  summing  those  squares,  and  then  dividing  by  the  count  of  the 
squares.  Thus: 


Variance  = 


Z(X-M)2 
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N  is  the  count  of  scores 

X  is  a  summation  sign  and  is  explained  by  the  example  below 

The  standard  deviation  is  the  square  root  of  the  variance.  Consider  the  following 
distribution  of  numbers:  10,  15,  20,  25,  30.  The  sum  is  100,  and  therefore  the  mean  is  20 
(=100^5).  The  variance  and  standard  deviation  are  calculated  as  follows  [X  denotes  a 
given  number;  M  denotes  the  mean  of  the  group  of  numbers,  and  (X-M)^  is  the  differ- 
ence between  the  number  and  the  mean  multiplied  by  itself]: 


X 

X-M 

(X-M)= 

10 

-10 

100 

15 

-5 

25 

20 

0 

0 

25 

5 

25 

30 

10 

100 

TOTAL 

250=5:(x-M)2 

The  variance  is  the  average  of  the  figures  in  the  last  column,  so  it  is  50  (=250-r5). 
The  standard  deviation  is  the  square  root  of  the  variance,  or  7.07.  In  practice,  there  are 
easier  formulas  for  calculating  the  variance  and  standard  deviation  (these  can  be  found 
in  any  basic  statistics  text).  Also,  typically  one  uses  a  calculator  or  computer  to  do  these 
calculations.  Intuitively,  the  standard  deviation  is  the  "average  amount  of  distance 
from  the  mean"  (disregarding  the  direction  of  the  differences). 

CONCEPTS  ASSOCIATED  WITH  ASSESSMENT  AND  TESTING 

Standardized  Test  (Norm  Referenced  Test) 

The  most  familiar  example  of  a  norm-referenced  test  for  BPS  is  probably  the  Met- 
ropolitan Achievement  Test  (MAT6).  Such  tests  have  in  common  the  fact  that  they  pro- 
vide a  systematic  sample  of  individual  performance,  are  supposed  to  be  administered 
and  scored  under  controlled  conditions  in  conformance  with  definite  rules,  and  that 
scores  are  interpreted  relative  to  a  norm  group.  For  nationally  standardized  tests  such 
as  the  MAT6,  the  norm  group  for  students  is  a  large,  representative  national  sample  of 
students  at  the  same  grade  level.  The  norms  reflect  expected  levels  of  achievement  for 
students  at  a  given  grade  level  on  a  given  test. 

Criterion  Referenced  Test 

Criterion-referenced  (or  content-referenced)  tests  are  designed  to  assess  the  spe- 
cific knowledge  and  skills  a  student  possesses  in  a  given  content  area.    A  familiar 
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example  in  Boston  is  the  CRT's  (Curriculum  Referenced  Tests)  which  are  given  as  final 
exams  in  many  subject  areas.  Scores  are  intended  to  reflect  how  weU  a  student  has  mas- 
tered a  set  of  prescribed  curriculum  objectives.  The  scores  measure  what  the  student 
knows  or  can  do,  rather  than  the  student's  performance  relative  to  some  external  refer- 
ence group. 

Standard  Score 

A  standard  score  is  a  mathematical  transformation  of  a  raw  score.  One  such 
score  (a  "z  score")  gives  the  deviation  of  one  score  from  the  mean  of  the  whole  group  of 
scores  in  relation  to  the  standard  deviation  of  the  group.  It  is  found  by  subtracting  the 
mean  of  the  group  from  the  individual  raw  score  and  dividing  the  result  by  the  stan- 
dard deviation.  Thus: 


Standard  score  (z)  = 


raw  score  -  mean 
standard  deviation 


An  advantage  of  standardizing  scores  is  that  they  can  be  compared  across  forms 
of  a  test  that  are  not  equal  in  difficulty.  Also,  they  may  be  linked  (equated)  across  levels 
of  a  test  to  form  a  continuous  standard-score  scale  allowing  comparison  across  levels  of 
a  test  (see  Scaled  Score  below);  raw  scores  carmot  be  used  for  these  purposes. 

Scaled  Score 

A  scaled  score  is  a  specialized  score  which  like  NCE's  and  stanines  has  equal 
units  across  its  scale.  (Differences  between  scores  have  approximately  the  same  mean- 
ing in  terms  of  performance  differences  at  any  point  along  the  scale).  On  the  MAT6, 
scaled  scores  can  vary  from  1  through  999  and  are  designed  to  permit  comparison  of 
performance  across  different  levels  or  forms  of  a  test.  A  score  of  600  should  mean  the 
same  absolute  level  of  performance  whether  it  is  obtained  by  a  6th  grader  or  by  a  12th 
grader,  although  it  would  be  a  much  "better"  performance  for  the  6th  grader  when  com- 
pared to  norms  than  it  would  be  for  the  12th  grader.  This  property  allows  scaled  scores 
to  be  compared  over  time,  as  long  as  the  same  overall  test  (such  as  Reading  Compre- 
hension) is  being  compared. 

Measurement  Error 

No  measure  is  100%  accurate.  An  everyday  weather  thermometer  may  be  a  de- 
gree or  so  off  and  still  be  useful.  A  statistic  called  the  standard  error  of  measurement 
(SEM)  provides  an  index  of  the  reliability  of  a  single  score  such  as  a  student's  MAT6 
Reading  Test  score.  The  standard  error  (SE)  provides  a  similar  type  of  index  for  a  group 
score  such  as  the  group  average  or  a  correlation  between  two  variables  in  a  group.  The 
size  of  the  standard  error  depends  on  the  size  of  the  group  and  the  size  of  the  standard 
deviation  of  the  group's  scores.  Both  indices  attempt  to  quantify  the  degree  of  error 
contained  in  a  number  and  are  usually  based  upon  group  averages. 
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Reliability 

In  developing  a  test  or  any  other  kind  of  measurement  procedure,  one  needs  to 
be  concerned  with  its  reliability,  or  its  consistency  in  measuring  whatever  the  test  is  in- 
tended to  measure.  Reliability  is  usually  expressed  in  the  form  of  a  reliability  coeffi- 
cient (ranging  from  0  to  1).  Reliability  typically  is  measured  three  different  ways. 

1.  Test-Retest  reliability   -  giving  the  same  test  twice.  The  question  is,  how 
well  do  scores  from  a  first  administration  of  the  test  correlate  with  a 
second  administration  of  the  test  to  the  same  group  a  short  time  later? 

2.  Alternate  Forms  reliability  -  giving  a  different  but  equivalent  form  of  test  on 
the  second  occasion.  Two  complete  versions  of  the  test  are  developed  (for 
instance.  Forms  L  and  M  of  the  MAT6)  and  compared. 

3.  Internal  Consistency  reliability  -  reliability  based  on  only  one  administration 
of  the  test.    There  are  many  ways  (probably  more  than  30)  of  assessing  the 
reliability  of  a  test  based  on  a  single  administration.  The  most  commonly 
used  reliability  coefficient  of  this  type  is  called  coefficient  alpha  or 
Cronbach  's  alpha.  Dividing  the  test  into  parts  and  correlating  the  parts 
according  to  certain  formulas  is  also  fairly  commonly  used  (e.g., 
split-halves  reliability).  A  simple  reliability  coefficient  a  teacher  may 
compute  to  determine  the  reliability  of  a  classroom  test  is  called  the  K-R 
21: 


n_ 


M(f>-M) 


where  n=  number  of  items  in  the  test 
M  =mean  of  the  total  test 
Sx=  variance  of  the  total  test 
rxx'  stands  for  the  K-R  21  reliability  coefficient 

The  closer  the  resulting  number  is  to  1 ,  the  more  reliable  the  test  is.  This 
formula  is  easy  to  use  because  the  teacher  only  needs  to  calculate  the 
mean  and  variance  of  the  total  test.  This  formula  assumes  that  all  items 
are  of  equal  difficulty  which  is  probably  not  true.  However,  it  serves  as  a 
reasonable  approximation  of  the  reliability  of  the  instrument  for  a 
particular  group  of  students. 


Validity 

The  efforts  to  establish  the  validity  of  a  measure  are  all  ways  of  trying  to  answer 
the  question:  Does  this  test,  questionnaire  (or  whatever)  measure  what  it  purports  to 
measure;  or,  more  correctly,  does  it  do  the  job  for  which  it  is  used?  This  second  idea  is 
more  correct  because  the  vaUdity  of  the  test  is  always  specific  to  the  purposes  for  which 
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the  test  is  used.    For  this  reason,  there  are  different  kinds  of  validity  evidence  used  to  de- 
termine the  validity  of  an  instrument  or  measure. 

1.  Content  or  curricular  validity.  This  is  the  extent  to  which  the  items  on  the 
test  adequately  sample  the  content  of  the  program  that  the  test  is  intended 
to  cover.  Content  validity  is  critical  for  Boston's  Curriculum  Referenced 
Tests  (CRT's).    A  non-technical  aspect  of  content  validity  is  referred  to  face 
validity.  If  a  test  has  face  validity,  it  "looks  as  if'  it  measures  what  it  is 
supposed  to  measure;  it  appears  relevant.    Face  validity  alone  is 
insufficient  proof  of  a  measure's  actual  validity. 

2.  Criterion  related  validity.  This  approach  presupposes  the  existence  of 
another  measure  of  the  same  characteristic  or  achievement.  Concurrent 
validity  is  the  degree  to  which  scores  on  the  test  agree  with  the  other 
measure  of  the  characteristic.  Predictive  validity  refers  to  the  degree  to 
which  a  given  test  predicts  some  future  related  event.  For  an  achievement 
test,  a  high  correlation  with  an  existing  well  regarded  measure  of 
achievement  would  demonstrate  concurrent  validity,  while  accurate 
prediction  of  success  in  college  would  be  evidence  of  predictive  validity 
for  a  test  such  as  the  SAT. 

3.  Construct  validity.  Construct  validity  is  the  problem  of  determining 
whether  the  variable  being  measured,  i.e.,  the  construct  being  assigned 
values,  is  in  fact  what  it  is  purported  to  be.  For  example,  is  the  score 
assigned  a  particular  examinee  really  a  measure  of  her  reading 
comprehension?  Although  there  are  statistical  methods  to  assist  in 
determining  a  given  measure,  validity  is  ultimately  is  a  philosophical 
issue  more  than  a  technical  one. 

Test  Bias  or  "Culture  Fair"  Tests 

Periodically,  there  have  been  concerns  that  standardized  achievement  tests  may 
do  a  disservice  to  members  of  certain  groups.  For  instance,  the  content  of  some  items 
has  assumed  familiarity  with  some  features  of  suburban  life  to  which  urban  children 
may  never  have  been  exposed,  or  the  content  of  items  may  be  of  much  more  interest 
and  familiarity  to  boys  than  to  girls  or  vice  versa.  Two  major  strategies  for  dealing  with 
this  problem  have  been  tried  over  the  years:  eliminating  items  on  which  there  are  big 
differences  across  groups  during  the  test  development  phase,  and  trying  to  develop 
relatively  nonverbal  tests  in  order  to  reduce  the  impact  of  cultural  differences. 

Performance  Assessment/ Authentic  Assessment 

Over  the  past  several  years  there  has  been  a  growing  interest  in  exploring  new 
ways  of  assessing  student  performance.  This  has  arisen  in  part  from  dissatisfaction 
with  an  over  reliance  on  the  use  of  multiple  choice  tests  to  provide  both  diagnostic  and 
evaluative  information  on  students  and  schools,  and,  in  part,  as  a  natural  consequence 
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of  curriculum  reform  arising  out  of  the  school  restructuring  movement.  The  overall 
purpose  of  these  approaches  to  student  assessment  is  to  provide  a  more  complete  and 
holistic  view  of  students'  achievement  by  sampling  behavior  closer  to  the  real  world 
and  real  skills  students  are  expected  to  learn  than  the  recognition  behaviors  involved  in 
taking  standardized  tests.  Portfolios,  projects,  experimentation,  and  so  on,  characterize 
these  approaches. 

The  basic  concepts  underlying  performance  assessment  are  intuitively  appealing 
to  educators.  Assessment  should: 

•  sample  actual  student  products  and  performances  rather  than  infer  what  students 
know  from  their  ability  to  recognize  correct  answers  from  a  list  of  alternatives; 

•  be  inconspicuously  embedded  within  instruction; 

•  involve  an  ongoing  dialogue  between  student  and  teacher  fostering  an 
understanding  in  the  student  as  to  what  excellence  in  the  domain  looks  like; 

•  take  into  account  more  than  one  way  to  express  excellence  within  a  domain; 

•  take  into  account  individual  differences  in  learning  styles  and  developmental 
stages; 

•  involve  defining  and  solving  ill-structured  problems  requiring  higher  order 
thinking  skills  simulating  "real-life"  situations  (Wolf,  1989;  Baron,  1990;  Gardner, 
1991;  Wiggins,  1992). 

Several  large-scale  implementations  of  these  approaches  are  being  tried  (e.g., 
Vermont,  Kentucky,  New  York).  Although  many  exciting  and  inventive  initiatives 
have  been  undertaken  (the  Boston  Public  Schools  and  Boston  College  are  involved  in 
one  such  initiative),  the  performance  assessment  arena  is  in  its  nascent  stages.  There  is 
much  work  to  be  done  to  develop  new  methods  of  determining  rehability  in  scoring 
and  validity.  Another  major  challenge  is  developing  a  cost  effective  way  to  pursue  this 
technology  and  train  teachers  and  administrators  to  utilize  performance  assessment  ful- 
ly and  correctly. 
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Forms  Enclosed 


1.  Needs  Analysis  Worksheet  (3  pages) 

2.  Three- Year  Education  Plan  (20  pages) 
(Includes  Action  Plan  Forms  for  Years  1-3) 

3.  Amended  Three- Year  Plan  Summary  (1  page) 

4.  Midyear  Progress  Report    (3  pages  -  sample 
only) 

5.  Midyear  Progress  Report  Amendment  Form 
(1  page) 

6.  End-of-Year  Report  (6  pages  -  sample  only) 


BPSR&D  Form-l  6/1993 


Appendix  C:  Forms 


Needs  Analysis  Worksheet 


Three- Year  Education  Plan 

1992-93  through  1994-95 
NEEDS  ANALYSIS  WORKSHEET  (Optional) 


Instructions: 

This  worksheet  is  provided  to  assist  in  the  data  analysis  process.  There  are  five  Needs  Catego-  J 
ries:  Academic  Performance,  Discipline/Attendence,  Teacher  Performance /Morale,  Integration ; 
SPED/  Bilingual,  and  Involvement  of  Parents.  For  each  category  needs  should  be  identified.  For  ex-  i 
ample,  a  number  of  schools  have  developed  parent  and  student  surveys.  From  these  surveys,  in- 1 
formation  will  be  gained  related  to  academic  performance  and  Bilingual  integration.  Thisii 
information  should  be  analyzed  and  the  findings  enumerated  in  the  section  "FINDINGS"  for  each ; 
Need  Category.  From  the  findings,  one  or  more  needs  will  be  identified  which  should  be  listed  in  li 
the  section  "NEEDS". 

Once  all  data  sources  have  been  analyzed,  and  all  needs  have  been  identified,  the  list  of  needs  j 
must  be  assigned  to  one  of  the  three  Superintendent's  priorities  and  also  prioritized.  It  is  important  r 
to  make  the  distinction  between  Needs  and  Programs/ Action  Steps.  Needs  target  the  areas  that  need 
strengthening.  For  example,  parents  perceive  that  the  children  need  better  reading  skills.  The  strate-  : 
gy  to  make  the  children  improve  in  reading  is   different  from  the  need.   The  development  of  these 
strategies  belong  to  the  next  phase   ~   developing  your  Three- Year  Plan  (Goals,  Objectives,  Action 
Plans).  This  phase  of  the  planning  process  should  be  limited  to  a  well  thought  out  needs  analysis. 

Academic  Performance 

DATA  SOURCE  or  SOURCES:  

(E.g.,  SY90-91  School  Profiles,  Metropolitan  Test  Data,  Mid  Year  Progress  Report  Systemwide  Indicators  Printout,  Parent 
or  Student  Survey,  Teacher  Observations,  Student's  Grades  and  Portfolios,  Administrator  Observations) 


FINDINGS: 

NEEDS: 

Office  of  Research  and  Development  -  4/7/92 


Three- Year  Education  Plan 

1992-93  through  1994-95 
NEEDS  ANALYSIS  WORKSHEET  (Optional) 


Discipline/Attendance 


DATA  SOURCE  or  SOURCES: 


(E.g.,  SY90-91  School  Profiles,  Metropolitan  Test  Data,  Mid  Year  Progress  Report  Systemwide  Indicators  Printout,  Parent 
or  Student  Survey,  Teacher  Observations,  Student's  Grades  and  Portfolios,  Administrator  Observations) 


FINDINGS: 

NEEDS: 

Teacher  Performance/  Morale 

data  source  or  SOURCES:  


FINDINGS: 

NEEDS: 

Three- Year  Education  Plan 

1992-93  through  1994-95 
NEEDS  ANALYSIS  WORKSHEET  (Optional) 

Integration  SPED/  Bilingual 

DATA  SOURCE  or  SOURCES:  

(E.g.,  SY90-91  School  Profiles,  Metropolitan  Test  Data,  Mid  Year  Progress  Report  Systemwide  Indicators  Printout,  Parent  i 
or  Student  Survey,  Teacher  Observations,  Student's  Grades  and  Portfolios,  Administrator  Observations) 


FINDINGS: 

NEEDS: 

Involvement  of  Parents 


DATA  SOURCE  or  SOURCES: 


FINDINGS: 


NEEDS: 
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Three- Year  Education  Plan 


Boston  Public  Schools 

THREE-YEAR 
EDUCATION  PLAN 

SCHOOL  YEARS  1992-93  through  1994-95 


SCHOOL ZONE 

ADDRESS 


TELEPHONE  NUMBER 


SIGNATURES 


Approved  for  Implementation: 

Principal     Date_ 


Zone 

Superintendent Date. 


Date  Forwarded  to  Superintendent: 


BOSTON  PUBLIC  SCHOOLS 

THREE- YEAR  EDUCATION  PLAN 

(1992-93  through  1994-95) 

School:    name R.C zone date 

WE,  THE  UNDERSIGNED,  attest  that  we  participated  appropriately  in  creating  this 
plan  and  will  give  the  plan  our  support  during  its  implementation. 

Title  Typed  Name  Signature  &  Date 

Principal  

Teacher  

Teacher  

Teacher  

Parent 

Parent  

Parent  

Other 

Community  Representative 

affiliation       

Community  Representative  

affiliation       

Community  Representative  

affiliation       

Community  Representative  

affiliation       

For  additional  school-based  people  use  an  additional  page 

Zone  Covmcil  Co-Chair  

Zone  Superintendent  


THREE-YEAR  EDUCATION  PLAN 
SY1992-92  THROUGH  SY1994-95 

Current  Significant  Achievements 
1992-1993 


SUPERINTENDENT'S  PRIORITY  1:  Improved  student  performance 


SUPERINTENDENT'S  PRIORITY  2:  Increased  parental  and  community  participation 


SUPERINTENDENT'S  PRIORITY  3:  Identification  and  support  of  students  with  unique  needs 


SUPERINTENDENT'S  PRIORITY  4:  Progress  with  respect  to  performance  on  the  Systemwide 
Indicators 
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Three- Year  Education  Plan 

THREE-YEAR  PLAN  SUMMARY 
SY1992-92  THROUGH  SY1994-95 

SUPERINTENDENT'S  PRIORITY  1:    Improved  student  performance 
Three- Year  Goal: 

Rationale: 

Year-One  Objective: 

Year-Two  Objective: 

Year-Three  Objective: 

SUPERINTENDENT'S  PRIORITY  2:  Increased  parental  and  community  participation 
Three- Year  Goal: 

Rationale: 

Year-One  Objective: 

Year-Two  Objective: 

ifear-Three  Objective: 

SUPERINTENDENT'S  PRIORITY  3:   Identification  and  support  of  students  with  unique 

needs 

Three- Year  Goal: 
Rationale: 

Year-One  Objective: 
Year-Two  Objective: 
Year-Three  Objective: 

SUPERINTENDENT'S  PRIORITY  4:   Progress  with  respect  to  performance  on  the 

Systemwide  indicators 

Three- Year  Goal: 
Rationale: 
i'ear-One  Objective: 
Year-Two  Objective: 
Year-Three  Objective: 
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Appendix  C:  Forms         i 
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Amended  Three- Year  Plan  Summary 


If  you  have  changed  any 
items  of  the  Three  Year 
Plan,  complete  this  entire 
fonn.  Otherwise  submit  a 
copy  of  the  original  Sum- 
mary fonm. 


Three-Year  Education  Plan 

AMENDED  THREE-YEAR  PLAN  SUMMARY 
SY1992-93  through  SY1994-95 


Date  Amended 


SUPERINTENDENT'S  PRIORITY  1:   Improved  student  performance 

Three- Year  Goal: 

Rationale: 

Year-One  Objective: 
Year-Two  Objective: 
Year-Three  Objective: 

SUPERINTENDENT'S  PRIORITY  2:  Increased  parental  and  community  participation 

Three- Year  Goal: 

Rationale: 

Year-One  Objective: 
Year-Two  Objective: 
x'ear-Three  Objective: 

SUPERINTENDENT'S  PRIORITY  3:   Identification  and  support  of  students  with  unique 

needs 

Three- Year  Goal: 
Rationale: 

Year-One  Objective: 
Year-Two  Objective: 
Year-Three  Objective: 

SUPERINTENDENT'S  PRIORITY  4:   Progress  with  respect  to  performance  on  the 

Systemwide  indicators 

Three- Year  Goal: 
Rationale: 
/ear-One  Objective: 
Year-Two  Objective: 
Year-Three  Objective: 


Appendix  C:  Forms 


Midyear  Progress  Report 


Boston  Public  Schools 

THREE-YEAR  EDUCATION  PLAN  (1993-1994) 

MIDYEAR  PROGRESS  REPORT 

Systemwide  Indicators 


Sample  Only 
Actual  Form  to  be  Sent 

■4n  Jsn-uarVv  1994 


School  Name . 


Zone. 


principal/ 


Headmaster 


Total  Enrollment. 


Black 


White 


Asian/PI 


Hispanic . 


Native  American 


Special  Education  Enrollment         Total_ 


.1 


.4 


Bilingual  Enrollment         Total. 


No  Step . 


Step2_ 


Step3_ 


Step  4_ 


Step  5 . 


Average  daily  student  attendance 
grades  KO  -  K2 
grades  1   -12 

perfect  attendance  _ 

absent  5  or  fewer  days  _ 

absent  between  6-10  days  _ 

absent  1 1  or  more  days  _ 

Suspensions 

occurrences  _ 

pupils  _ 

Annual  Dropout 

#  of  students  who  dropped  out  _ 

school  enrollment  _ 

SPED 

students  reviewed  _ 

prototype  increase  _ 

prototype  decrease  _ 

new  referrals  _ 

referred  by  school  _ 

referred  by  extemal  agencies  _ 

referred  by  parent  _ 

with  pre-referral  not  waived  _ 

Staff  Attendance 

Average  staff  attendance 

0  Sick  Days  _ 

1-5  Sick  Days  — 

6-10  Sick  Days  — 

I 11  or  more  Sick  Days __ 

"This  number  includes  proposed  and  signed  plans 


_% 
% 


^ 


g& 


_% 
% 


% 


st- 


^ 
5^^^ 


#■ 


^ 


■^ 


# 


.^ 
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Boston  Public  Schools 

THREE-YEAR  EDUCATION  PLAN  (1993-1994) 

MIDYEAR  PROGRESS  REPORT 

Systemwide  Indicators 


Sampie  Only 
Actua!  Form  to  be  Sent 

in  January,  199^1 


School  Name . 


Zone. 


Principal/ 
Headmaster 


DIRECTIONS:    In  the  Mid-year  Progress  column,  comment  on  the  progress  made  to  date  for  each  Systemwide  indicator.  Comments 
should  assess  the  effectiveness  of  specific  actions  taken  to  maintain  or  improve  performance  on  each  indicator. 


Student  attendance 


Suspensions 


Annual  Dropout 


Bilingual 


SPED 


Staff  attendance 


Page  2  of  3 


Boston  Public  Schools 

THREE-YEAR  EDUCATION  PLAN  (1993-1994) 

MIDYEAR  PROGRESS  REPORT 

School  Level  Indicators 


Sampie  Only 
Actual  Form  to  be  Sent 

in  January t  1994 


School  Name . 


. Zone_ 


Address. 


)IRECTIONS:  In  the  last  column,  indicate  the  school's  perfomnance  to  date  on  each  of  the  objectives  as  reflected  by  the 
Tieasures  of  success. 


"kf^^^^   ^  T^jT%j^yj^B^B|^BBMBwMB|MMftjMjM^HWB                       ^'^'^^ .fi£fScii£ti3'3^  \^'~<vn  w'^v 

i^^s:^  i.^M^Z^-^^^-"^.    -  . '       -                                                   '     ■         -     ■              •                                      -Wj 

Superintendent's  Priority  #1: 

Superintendent 's  Priority  #2. 

~ 

Superintendent 's  Priority  #3: 

Superintendent 's  Priority  #4: 
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Appendix  C:  Forms 


Midyear  Progress  Report  Amendment  Form 
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Appendix  C:  Forms 


End-of-Year  Report 


Boston  Public  Schools 


Sample  Only 

Actual  Form  to  be  Sent 

in  September,  1993 


J 


THREE-YEAR  EDUCATION 

PLAN 
END-OF-YEAR  REPORT 

school  year  1992-93 

(September,  1993) 


■ -^ 

Principal/              4^ 
School  Name Zone Headmaster        .^0^ _A> 

Fotal  Enrollment Black White Asian/PI^J?  Hisp  ^_^ot^  Amer. 

^            V 
Special  Education  Enrollment         Total .1         ^  .2 ^^ .4 

Bilingual  Enrollment  Total No  Step StmT Step  2:^ Step  3 Step  4 


Mumber  andpercentof  students  attending  school  from  10/15/92-6/1/93     N= % 


BOSTON  PUBLIC  SCHOOLS 

THREE-YEAR  EDUCATION  PLAN 

END-OF-YEAR  REPORT 

1992-93 

Schooll    name R.C zone date.. 


WE,  THE  UNDERSIGNED,  attest  that  we  participated  appropriately  in  supporting 
the  implementation  of  this  plan. 

Title  Typed  Name  Signature  &  Date 

Principal  


Teacher 

Teacher 

Teacher 

Parent 

Parent 

Parent 

Other , 


Community  Representative 
affiliation       


Community  Representative 
affiliation       


Community  Representative 
affiliation       


Community  Representative 
affiliation       


For  additional  school-based  people  use  an  additional  page 

Zone  Covmcil  Co-Chair  

Zone  Superintendent  


ichool: 


Boston  Public  Schools 
THREE-YEAR  EDUCATION  PLAN 
END-OF-YEAR  REPORT 
(1992-1993) 


Sample  Oniy 

Actual  Form  to  be  Sent 

in  September,  1993 


IIRECTIONS:  In  the  last  column,  indicate  the  school's  end-of-year  performance  on  each  of  the  objectives  as  reflected  by  the 
leasures  of  success. 


uperintendent's  Priority  #2: 
[mproved  student  performance) 


verintendent  's  Priority  #2: 
.(Creased  parental  and 
Dmmunity  participation) 


uperintendent  's  Priority  #3: 
identification  and  of  support  of 
tudents  with  unique  needs) 
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Boston  Public  Schools 
THREE-YEAR  EDUCATION  PLAN 
END-OF-YEAR  REPORT 
(1992-1993) 


Sampie  Only 

Actual  Form  to  be  Sent 

in  September.  1993 


School  Name 


Superintendent's  Priority  #4: 

(Progress  with  respect  to  performance  on  the  systemwide  indicators) 


Average  daily  student  attendance 

Gr.  KO  -  K2 

Number  of  suspensions 

Number  of  pupils  suspended 

Number  and  percent  promoted 

Number  and  percent  that  dropped  out  (Annual  Rate) 

MAT6  Median  Percentiles 


% 


_% 


% 


.% 


% 


% 


M    R 


M 


Grade  1 
Grade  2 
Grade  3 
Grade  4 
Grade  5 


OR 


Grade  6 
Grade? 
Grade  8 


OR 


Grade  9 
Grade  10 
Grade  1 1 
Grade  12 


r^ 


^ 


M 


^^ 


Percent  eligible  population  taking  MAT6  tests 
Students  scoring  below  40th  %ile  on  the  MAT6 
Students  scoring  from  40th  to  60th  %le  on  the  MAT6 
Students  scoring  above  60th  %ile  on  the  MAT6 
SPED:      -prototype  increase 

-prototype  decrease 

-new  referrals  (number  only) 

Bilingual  -students  with  step  increases 

Average  staff  attendance 

Regular  education  students  in grade  requesting  this 

school  as  top  choice  in  first  round. 


<r 


% 

% 

% 

% 

% 

% 

% 

% 

% 

% 

% 


% 


% 


% 
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chool  Name: 


Boston  Public  Schools 
THREE-YEAR  EDUCATION  PLAN 
END-OF-YEAR  REPORT 
(1992-1993) 


Sample  Only 

Actual  Form  to  be  Sent 

in  September,  1993 


^■^^^^H^^Bp'             _     <#^-«|-jf^iia»aBggaBI^^^^^^^M 

I^^MME    1<tOft.Q1-^^ 

■ 

I 

HI 

■ 

ttudent  Attendance 

Perfect  attendance 
Absent  5  or  fewer  days 

Absent  between  6-10  days 

Absent  1 1  or  more  days 

% 

% 

% 
% 

% 
% 

% 

% 
% 

% 

% 

Mlingual 

^ 

o 

-in  program  3  years  or  less 
-in  program  more  than  3  years 

% 
% 

o^ 

% 
% 

^ 

w 

JPED  new  referrals 

4> 

(^ 

-referred  by  school 

-referred  by  external  agencies 

-referred  by  parent 

-with  pre-referral  not  waived 

% 

^     % 

^          % 

% 

% 
% 
% 
% 

Average  staff  attendance 

0  sick  days 

1  to  5  sick  days 
6-10  sick  days 

1 1  or  more  sick  days 

% 
% 
% 
% 

% 
% 
% 
% 

% 
% 
% 
% 

Regular  education  students 
administratively  assigned  to                    B 
school  by  race  at  end  of  1  st 
round 

W                   A 

_   H  . 

o 

— 
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Boston  Public  Schools 
THREE-YEAR  EDUCATION  PLAN 
END-OF-YEAR  REPORT 
(1992-1993) 


Sample  Only 

Actual  Form  to  be  Sent 

in  September.  1933 


School  Name: 


DIRECTIONS:    Comment  on  the  end-of-year  status  for  each  Systemwide  indicator.  Comments  should  focus  on  specific  actions 
taken  and  the  effectiveness  of  the  specific  actions  to  maintain  or  improve  performance  on  the  indicators.  Any  additional  evidence  felt  to 
be  relevant  and  not  provided  elsewhere  may  be  included  here. 


Student  attendance 


Suspensions 


Promotions 


Annual  Dropout 


SPED 


Bilingual 


Staff  attendance 


Metropolitan 
Achievement  Data 
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